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ABSTRACT 

\ National compensatory education and the relationship 

between student achievement growth and educational processes are 
assessed in a first year report of the Sustaining Effects Study 
^ required by Title I ot the Elementary and Secondary Education Act of 
1965. Federal funds were authorized to provide special compensatory 
-services to educationally deprived students. Study data include 
achie vement scores; .attitude measures; aspects of instructional 
, service; and educational programs. Analyses approaches are varied. 
" Part One discusses the effects of compensatory education in 

educational development and achievement. Instructional effects are 
analyzed and a structural-relation model is discussed. In Part Two 
the relationship between^the educational process and development is 
presented in terms of data and analysis strategy. Basic skills 
achievement is considered with the influence of environment and 
instructional staff and practices. The characteristics of effective 
educational processes and students are discussed. Chapter summaries 
• and conclusions, a bibliography, appendices of support material, and 
supplementary tables are included. (CM) \ 
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A GENERAL INTRODUCTION TO THE SUSTAINING 
. EFFECTS STUDY AND 
AN OVERVIEW OF THE PRESENT REPORT 



DESCRIPTION OF THE STUDY 

In response to questions about educational policies, SDC is studying compensatory education 
(CE)— its nature, quantity, and sustained effects — in a large study called The Sustaining Effects 
Study., This.study will result in a series of reports from the following substudies: 

• The longitudinal Study. In the Longitudinal Study, the growth of children in reading, math, func- 
tional literacy, and attitudes toward school were assessed in the fall and spring for three consecutive 
years. The amount and kind of instruction in reading and math was also determined for each stu- 
dent. In addition, teachers and principals report ontheir practices of instruction and teaching- Thus, 
it was possible not only to assess student growth over a three-year period, but to relate this growth 
* to aspects of instruction. 

The schools in the study were drawn from three different groups. The REPRESENTATIVE SAMPLE of 
schools is a sample cafefully drawn to represent all of the nation's public schools that have some of 
the grades one-through-six. A second group of schools, the COMPARISON SAMPLE, is composed of 
schools that have large proportions of students from poor homes but do not receive special funds to 
offer CE services. The third group is the' NOMINATED SAMPLE, composed of schools nominated 
because their educational programs had promise of being effective for low-achieving students. Dur- 
" ing the first year of the study, data were collected from 328 schools and about 1 18,000 students. 

The Cost/Effectiveness Study. Information was obtained on the resources and services to which each 
student was exposed during reading and math instruction. Cost estimates were generated on the 
basis of this information. Because the effectiveness of the instructional programs is being deter- 
mined in the Longitudinal Study, it is possible to relate the effectiveness to the cost of each program. 

The Participation Study. The purpose of the Participation Study was to determine the relationships 
among economic status, educational need, and instructional services received. The educational 
achievement of the students and the services they received were obtained in the Longitudinal 
Study, and the refined measures of economic status were obtainecHn the Participation Study. Visits 
were made to the homes of over 15,000 randomly selected studerits/rrom the schools in the first- 
year REPRESENTATIVE SAMPLE. During the visits, information was collected on the economic level 
of the home and on the parents' attitudes towflcjl their children's school and learning experiences. 
Thus, the level of student achievement and services could «r related to the economic level of a stu- 
% dent's home. * ' i 

The Summer Study. The Sustaining Effects Study also examined the effectiveness" and cbst- 
effectiveness of summer-school programs Jnformation^bout the summer school experiences of .the 
c students^vas combined with other data.. The resource-cost model, developed for the regular-year, 
'•cost-effectiveness study; was adapted to the needs of the summer-school study. 

) f . 
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Successful Practices in High-Poverty Schools. This study identifies and describes instructional prac- 
tices and contexts that are effective in raising the reading and math achievements of educationally 
disadvantaged students. In-depth observational and interview data were collected from 55 schools 
. that participated in the study., 

THE REPORT SERIES 

The major findings of the reports already published are discussed briefly below, along with 
references to the specific reports from the study that address them. i 

A Description of the Samples for the Sustaining Effects Study and the Nation 's Elementary Schools. In 
order to understand the findings of tois study, it is essential to become familiar with the 
characteristics of the samples used ancj/tneir capabilities of providing generalizations to the popula- 
tion of the nation's schools. Technical Report 1 (Hoepfner, Zagorski, and Wellisch, 1977) describes 
in detail the samples and how they were formed. It also presents the results of a survey of 4,750 
public schools with grades in the 1-6 range by projecting the data to the nation. These projections 
accurately describe the nation's elementary schools in terms of their characteristics, the kinds of ser- 
vices they provide to students, and the characteristics of the students. The interrelationships among 
these characteristics are also addressed. 

Some characteristics of the nation's public schools are summarized below: 

• Enrollment, Urbanism, and Achievement The total grade 1-6 enrollment in the 1975-76 
school year was estimated at about 21 million students. There is a moderately strong relation- 
ship between enrollment and urbanism, with large cities having larger schools than rural 
areas. In general, schools in large cities have lower achievement levels than those in rural 
areas. 

«k 

• Compensatory-Education Funds, School Characteristics, and Achievement. About two-thirds 
of the nation's elementary schools received Title I funds, and about one-fifth received no 
compensatory funds from any sources. There is little relationship between receipt of com- 
pensatory funds and the size of a school. However, small-city and rural schools tend to 
receive such funds more frequently ihan do large-city schools. As expected, schools with 
high concentration of poor students tend to receive compensatory funds more often than do 
schools with low concentration. Similarly, schools with higher percentages of low-achieving 
students are more likely to receive compensatory funds. 

<* 

• Achievement and Concentrations of Poor and Minority Students. There is a strong association 
between percentage of low-achieving students and concentrations of poor and minority 
students. 

• School's Grade Span. Generally, the grade span in the school has small relationships with the 
size of school, degree of urbanism, and concentrations of low-achieving, poor, and minority 
students. 

• Stability of Student Body. Schools tend to have less stability in their student bodies as the size 
of the school increased, and there tends to be less stability in large cities. Similarly, stability 
decreases as concentrations of poor, minority, and low-achieving students increase. j 

• Av/kilability of Summer Schools. Fifty-one percent of the nation's schools with grades 1 -6 have 
surnmer-school programs available for their students. Larger schools provide summer-schopl, 
programs more frequently than do smaller schools. Tht r e is practically no relation between 
the availability of summer school and a school's level of poverty, minority concentratibn, or 
level of achievement of the students. . ; 

A Description of Student Selection for Compensatory Services as It Relates to Economic Status and 
Academic Achievement. The Education Amendments of 1974 require v ^eyeral studies to inform 
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Congress who does and who does not receive Title I services and how selection for such services is 
related to economic status of the family and the academic performance of the child. In addition, the 
federal program administrators wanted to know the differences between the services received by 
economically and educationally deprived children and those by non-deprived children, and the 
relationships between academic achievement and the children's home environment. These ques- 
tions were addressed in Technical Reports 2 (Breglio, Hinckley, and Beal, 19 7 9\ 3 (Hinckley, Beal, 
and Breglio, 1978), and 4 (Hinckley, Beal, Breglio, Haertel, and Wiley, 1979). A brief summary of 
answers to the questions is provided below: 

• About 29 percent of poor students participate in Title I compared to about 1 1 percent of the 
non-poor students (Report 2). Looking at CE in general, about 40 percent of the poor 

( students and about 21 percent of the non-poor students participate. From these findings, we 
can see that proportionally more poor students participate in the services than non-poor 
ones. 

• Using the grade-equivalent metric as the definition for educational disadvantage (one year 
below expectation for the student's current grade), about 31 percent of the low-achieving 
students participate in title I, while only ICLpfercent of the regular-achieving students do 
(Report 2). For CE in general, the percentages are 46 for low achievers and 19 for regular 
achievers. Among the regular achievers who participate in CE, many score below the 

national median on achievement tests. 

\ 

• Participation rates for Title I and for CE in general are the highest for students who are both 
economically and educationally disadvantaged (Report 2). Forty-one percent of these 
students participate in Title I, and 54 percent participate in CE in general. Participation rates 
are next highest for students who are educationally but not economically needy (26 and 
41 percent, respectively), and next highest for students economically but not educationally 
needy (20 and 28 percent, respectively). Only 7 percent of the students who are neither 
educationally nor economically needy participate in Title I (15 percent for CE in general). 
These participation rates were interpreted as indicating that the then-current allocation pro- 
cedures Were being complied with and that the intentions t>f the law were^being met fairly. 

• In comparison to non-poor students, poor students receive more hours of instruction per 
year with special teachers, more hours of instruction in medium- and small-sized groups, 
fewer hours of independent study, more non-academic services such as guidance, counsel- 
ing, health and nutrition (Report 3). The differences are even stronger when poor Title I 
students are compared to others. Therefore, we can conclude that the distribution of educa- 
tional services is in line with the intent of the laws and regulations. 

• Two aspects of the children's home environments bore significant and consistent relations to 
achievement: amount of reading done at home and the educational attainment of the head 
of household. Other variables, such as family size, TV-watching behavior, and type of living 
quarters were not consistently related to student achievement (Report 4). Although most 
parents (67 percent) know whether their children's schools have special. programs for low- 
achieving students, few (40 percent) know of Title I and even fewer know of or participate in 
local governahce of the Title I program. Poor parents, in general, are less involved in their 
children's educational programs, have lower expectations of their children's attainments, 

" give lowerjatings to the quality of their children's educations, but perceive Title I and'ottier 
CE programs as being helpful. *' 

Description of the Nature nf CE Programs, Characteristics of Participating Students, Schools, and 
Educational Services. The Participation Study deals almost exclusively with what has been called 
'selection for CE or Title I services,' without examining too closely what such programs really are 
ancj how they differ from the programs regularly offered by the schools. Before we could draw any 
relationships between participation in a CE program and the educational progress of students, we 
had to be assured that there really was a program that was distinct, could be specified in some way, 
and had a reasonable chance of making an impact. As will be seen, not only did we analyze data on 
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the basis of program participation, but we also considered the actual services received in order to 
address directly the possible differences between the intention and the actuality. 

i 

Based on the analyses of data obtained from about 81 ,500 students in the Representative Sample of ' 
schools, Technical Report 5 (Wang, Hoepfner, Zagorski, Hemenway, Brown, and Bear, 1978) pro- 
vides the following important conclusions: 

• Students participating in CE are lower achievers (mean score at the 32nd percentile) than 
non-participants (53rd percentile). Seventy percent of the participants were judged by their 
teachers as needing CE, while only 19 percent of those not participating were so judged. 
More minority students participate in CE, proportionately, than white students, but participa- 
tion in CE has little relationship with student attitudes to school, early school experience, 
summer experiences, or the involvement of their parents in their educational programs. 

• Minority," poor, and low-achieving students tend to receive more hours of instruction in 
smaller groups and by special teachers, and receive more non-academic services, but their 
attendance rates are generally lower too, so they do not take maximum advantage of the 
special services provided. 

• The useful predictors of whether or not a student is selected to receive CE are his/her 
teacher's judgment of need and participation in CE in the previous year. When these 
variables are considered, achievement scores, non-English language spoken in the home, 
and economic status contribute little more to the prediction. 

• About two-thirds of the. students participating in CE in 1975-76 participated in tfye 1976-77 
school year also. 

t" • CE students in general and Title I students ih particular receive more total hours of instruction 
per year than non-CE students. The CE students also receive more hours of instruction from 
special teachers. Among CE students, Title I students receive the greatest number of hours of 
instruction, more frequently with special teachers, and in small instructional groups. There 
are no significant and consistent differences betvveen CE students and non-CE students yvith 
regard to their teacher's instructional subgrouping practices, use of lesson plans, extent of 
individualization of instruction, frequency of feedback, or assignment of homework. 

• Students receive between five and nine hours of reading instruction per week, decreasing 
steadily with higher grades, and between five and six hours of math instruction per weejc, 

jfairjy constant over all grades. 

1 

• (CE services are delivered during regular instructional hours with different kinds of activities 
for the participants (so that, in effect, they 'miss' some regular instruction received by their 
jion-participating^eers). 

• Title I schools have higher average per-participant CE expenditures in reading and math than 
do schools with other CE programs. The average Title I per-participant expenditure is about 
35 percent of the average per-pupil regular (base) expenditure. 

• Schools receiving CE generally have higher concentrations of poor students and low- 
ichieving students, and students with less educated parents. These schools have greater 
administrative and instructional control by their districts and have higher staff-to-student 
ratios. 

• Schools that select higher percentages of regular-achieving students for CE services have 
larger percentages of minority and poor students, probably reflecting their tendency for 
saturation of CE program.',. 
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• Most districts use coupts of students receiving reduced-price lunches and counts of aid to 
families with dependent children to determine^ school eligibility for compensatory funds, 
while most schools select students on the basis of standardized achievement tests, frequently 
augmented by teacher judgments. Similar selection criteria are employed by non-public 
schools. 

Cost-Effectiveness of Compensatory Education. In its deliberations for the reauthorization of Title I 
and in annual appropriation hearings, members of Congress also wanted information on the effec- 
tiveness of the Title I program relative to its cost. While it appears eminently sensible, to ask the 
question of cost-effectiveness, it is difficult to provide the answers in a manner that will be inter- 
preted correctly. 

In the study of cost-effectiveness of CE, efforts were made to preclude enigmatic conclusions and, at 
the same time, to make cost estimates on a sounder basis than in the past. In Technical Report 6, 
Haggart, Klibanoff, Sumner, and Williams (1978) develop and present a resource-cost model that 
translates educational resources for each student into estimates of average or standard dollar cost 
for his/her instructional program, The overall strategy for estimating cost is to provide an index that 
represents the labor intensity of services without being confounded with regional price differentials 
or different accounting methods. 

*■ 

Using the resource-costs, CE students in general, and Title I students in particular, were found to be 
offered substantially higher levels of educational resources, and hence, more costly programs. 
Participation in CE differentiates the r^iource-costs for services offered much more than do poverty, 
achievement level, race, or any othe^ characteristics. 

s 

In Technical Report 7, Sumner, Klibanoff^nd Haggart (1979) related resource-costs to achievement 
to" arrive at an index of cost-effectivenessTliecause of the low achievement levels of the children 
participating in CE and their relatively slow rates of achievement growth, the increased cost 
associated with CE appeared to be misspent (in the same way that money for severely ill and ter- 
minal patients appears to be not as effectively speftt as it is for mildly ill patients). It is important to 
point out, however, that the appearance may not tell the true story. Because we cannot obtain truly 
appropriate comparison groups, we do not know what would have happened to the achievement 
growth of the CE students if they had not participated. Based on the compa;ispn groups we could , 
form, however, CE programs did not appear to have an advantage over regular programs in terms of 
cost-effectiveness. 

The Effectiveness of Summer-School Programs. The study has also examined the results of atten- 
dance at summer school, because members of Congress and program administrators want to know 
if such attendance helps prevent the presumed progressive academic deficit of low-achieving 
students. If attendance at summer school has positive academic effects insofar as the attendees will 
not 'fall back' to their achievement levels of previous years, then summer programs can be con- 
sidered as a means of siistaming the school-year growth. 

Technical Report 8 (Klibanoff and Haggart, 1980) shows that attendance at summer school has little 
or no effect orr the academic growth of the students who attend, especially t!ie low-achieving 
, students. Because the findings are based on the study of summer schools as they presently exist (and 
the evidence is strong that they do not offer intensive academic experiences), *the non-positive 
findings should not be interpreted as an indictment of summer school, as such, but an evaluation of * 
the way they are presently organized and funded. Nevertheless, when instructional services 
delivered in summer schools were investigated, none seemed particularly effective in improving 
students' achievement gr^th. 

In the same report, the authors also addressed the hypothesis of 'summer drop-off,' a hypothesis 
advanced to explain the presumed widening achievement gap between regular and CI: students. 
Essentially, this hypothesis states that CE students lose much'more of their previous year's learning 
during the summer recess than do regular students. Data collected in the study fail to support the 
summer drop-off hypothesis: CE students do not suffer an absolute 'drop-off' (although their 
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achievement growth over the summer is less than that for regular students, as in the school year). In 
any event, attendance at summer school does not have much of an effect. 

(Technical .Report 9 is a resource book. It identifies all the variables and cbmposites that have been 
selected or devised for use in the Sustaining Effects Study. All measures and scales are described and 
rationalized. In addition, Report 9A serves as a companion volume that contains copies of all the 
data-collection instruments in the study except for a few that are constrained by copyright.) 

The Effects of Compensatory Education and Educational Development of Students. The present 
report (Technical Report 10) addresses the effects of compensatory services on student's develop- 
ment during the school period. It also examines the instructional services and/major dimensions of 
the educational process to describe the characteristics of programs that are effective in raising 
achievement level. The analysis is based on the first-year data of the study. Similar investigations will 
continue in subsequent reports. I 

Studies Still to be Done. The remaining reports, yet to be issued from the study, will address the 
general effects of educational practices on raising students' achievement levels, with special atten- 
tion paid to the practices found in CE programs in'general and in Title I programs in particular. 
Impact analyses will either be based on three-year longitudinal data or will be based on in-depth 
observations and interviews. The extensive achievement data collected from overlapping cohorts of 
students in the three years will be utilized to describe the patterns of educational growth over the 
years for various groups of CE and non-CE students. Analyses of the three-year longitudinal data will 
- allow us to examine the sustained effects of CE and help us determine if the presumed phenonenon 
of gap-widening between the disadvantaged and non-disadvantaged students indeed exists. 

OVERVIEW 

This report presents the first-year findings of the Sustaining Effects Study. The objectives are to 
examine the effects of compensatory services on the educational progress of students during the 
school period and determine the educational.dimensions that promote achievement growth. The 
report is based on data from the first year of the study which include a nationally representative 
sample of schools. It examines the patterns of students' achievement in reading, math, and practical 
skills and compares them between students who do not receive compensatory services in order to 
assess the effects of such services. It also investigates the relationships between achievement growth 
and major aspects of the educational process (e,g., instructional services, instructional personnel, 
policies and practices, and school environment). 

The central findingof this report is that, during the school year, compensatory services have positive 
impacts on reading achievement primarily at the first three grades and, later, at grade 6, and on 
math achievement at all grades. The ways in which the observed effects come about, however, are 
not clear; and the beneficial effects of compensatory programs, while detectable, are not large. 
Whether the effects are worth the costs involved awaits social and political judgments; whether the 
effects will be sustained over the years awaits analyses in the future reports of this study, f 

This central finding is derived from Part I of the report, concerning the effects of Compensatory 
Education and Instructional Services. The key findings from Part II, on the Relationships Between the 
Educational Process and Educational Development, are: 

• The amounts of regular instruction and tutor/independent work have some positive, but 
modest, effects on achievement growth. On the other hand, amount of instruction by special 
teachers, aides, and assistants, or in small groups (less than seven students) does not often 
have detectable effects; and when it does, the effect is negative. 

• Students taught by more experienced teachers tend to obtain greater growth in both reading 
and math achievement. This finding is generally consistent across the six elementary grades. 

• With regard to existing conditions of the school, students in schools having higher concentra- - 
tions of compensatory-education students, although they tend to be low achieving, achieve 
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slightly greater growth than their comparable peers in schools having lower concentrations. 
This result is obtained for both reading and math, particularly at the first two grades. At the 
same time, a higher concentration of low achievers in the school is frequently less conducive 
to achievement growth. As these two conditions tend to coexist in the s^me schools, the 
compensatory effort would merely help alleviate the disadvantage of the students in these 
schools. 

• Temporary disturbance of instruction caused J>y_physical fights or violence tends to hamper 
reading and math-achievement at : the upper three grades, but not at the earlier grades. 

• More frequent feedback to students regarding their academic progress sometimes helps 
therp achieve greater growth in reading and math. 

• At some grades, the more time teachers devote to planning and evaluation of the programs, 
the greater their students grow in reading achievement. 

• There are few interaction effects on achievement between student characteristics and educa- 
tional process. Where there are significant interactions, the differential effects of the educa- 
tional dimensions rarely reveal a systematic and meaningful pattern over the grades; and the 
association between the effects and student characteristics is weak. 

The report addresses seven specific questions. The first four are discussed in Part !; the second three 
in Part 11. 

1 , During the school year, do compensatory-education students demonstrate greater educational 
development than expected of them without compensatory services? 

In general, there are positive effects of compensatory services on the achievement growth of 
students in both reading and math — compensatory-education students achieve appreciably 
larger gains than the expectations. However, the magnitude of the effect is dependent on the 
comparison standards and analytical approaches. The supportive evidence of positive 
impacts is less clear in reading than in math. In reading, positive but small effects are 
demonstrable at the first three grades and, later, at grade 6. In math, such impacts are shown 
at all elementary grades, although to different degrees. The positive effects are mostly 
observed in programs that are funded at feast in part by Title I; there is little evidence of such 
effects in programs that are funded exclusively by non-Title 1 sources. 

There are seldom contradictory findings among different analytical methods based on vary- 
v ing assumptions. Compensatory programs, Title I in particular, are effective in accelerating 
student achievement growth during the school period. As a result, the programs are 
expected to help narrow the anticipated achievement gap between the participants and their 
non-disadvantaged peers. 

Partly because of the inadequacy of the measures, there are few noteworthy findings with 
respect to the effects of compensatory programs on .practical achievement and attitudinal 
development. 

2. Within a school year, do the instructional services delivered to compensatory-education 
students result in reduction of the anticipated achievement gap between them and regular 
students? 

The previous question referred simply to the effects of compensatory programs; this one asks 
about the role of instructional services. The direct answer is that there is no striking evidence 
that amount of instructional services is the primary factor affecting achievement growth. 
There are generally positive relationships between achievement growth and total instruc- 
tional time, but the relationships are weak. 
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In samples consisting of students who receive compensatory services and those who do not 
receive the services but are judged to have need for them, the multipje-regression analyses 
conclude that amounts of instruction in three settings (regular, special, and tutor/indepen- 
dent) jointly contribute very little to the explanation of the achievement variations at the 
posttest, relative to the contribution of pretest achievement and background factors. The 
table belowgive»s the range of the contributions in the six grades. * 

Proportions of Variance of Posttest Scores Accounted For 



Variance Component Reading Math 



Unique to pretest score and student background 


.31 - 


.57 


.27- 


.49 


Unique to amount of instruction received 


.00- 


.01 


.00- 


.01 


Unique to CE-selection status 


.00- 


.00 


.00- 


.01 


Shared by two or more of the three sets of variables 


.04- 


.07 


'.02- 


.07 


(Variance unaccounted for) 


.34- 


.64 


.47- 


.65 



Note that in this table, categories of compensatory programs also account for a very small 
proportion of the posttest variations. This may appear to refute the positive effects of com- 
pensatory^ rvices indicated in question 1 aboVe. For two reasons, it does not, however: first, 
with samples as large as those in this study, statistical significance can be consistent with 
small explanatory power; second, participation in compensatory programs can affect 
achievement by ways of its relationship with other variables (for example, see the fourth row 
of the table). *■ 

further examination of the roles of different kinds of instruction reveals that amounts of 
regular instruction and independent work have positive effects on achievement, while \ 
amount of special instruction that characterizes the services received by compensatory* 
education students rarely shows an appreciable effect. In light of this finding, it is concluded 
that the positive effects of compensatory programs cannot be attributed to the amount of 
special services provided to the students. 

3. What is the critical level of effort for reducing this anticipated achievement gap? 

There is not enough evidence to support the concept of a 'critical level' of effort above which 
compensatory-education students will achieve larger gains than normally expected of them 
to result in a narrowing of the anticipated achievement gap between them and regular 
students. The data from this study frequently do not confirm the expectation that achieve- 
ment growth increases with level of instructional effort (which is measured by the resource- 
cost of the services). Lacking clear evidence of such a trend, it is not po*ibleto determine 
the level cf effort that will ensure an improvement of the relative achievement standings of 
compensatory-education students. \ 

Supplemental analyses reveal that only in a few cases, achievement growth increases consis- 
tently as the level of effort is raised, but this trend is generally weak. In most cases, the data 
show a slight trend of larger gains for greater efforts up to a certain level; and then as the 
effort-level continues to rise, this trend reverses itself. It is suggested that the chances of 
finding a critical level of effort, if it exists, may be improved by refining the measures of 
achievement growth and instructional effort. 

4 Does compensatory education Jiave greater effects on the participants' achievement growth at 
some grades than at others? Are the effects different for students who did and did not par- 
ticipate a year earlier? And, does this pattern of differences vary with the amount of services 
received? 
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The cross-sectional analysis shows that, under current implementation, compensatory ser- 
vices benefit th$ participants more at the earlier grades, particularly the first grade. Such 
greater effects are not accompanied by greater effort of the programs. It is concluded that 
earlier compensatory services are more efficient in helping the participants improve their 
achievement. 

The beneficial effects of compensatory services are evident mostly in programs that receive 
at least partial support from Title I funds. The relative effects of Title I services at the six grades 
can be seen by comparing the average percentile changes from pretest to posttest between 
Title I students and a stapdard group of students. The standard group comprises students 
who are judged to have need for cpmpensatory services, but do not receive such services 
because their schools do not have compensatory programs. The pretest and posttest percen- 
tile scores for these two groups are plotted in the following figure by grades to illustrate the 
larger gains of Title I students (relative to the standard group) at the earlier grades. 

* 

The effects of Title I services on reading achievement are particularly noticeable at the first 
three grades, where the average percentile rank of Title I students rises at the posttest, while 
„ that of the standard group falls. By comparison, the effects of Title I services on math achieve- 
ment are not strikingly different among grades, although the effects remain more substantial 
at the earlier grades. 

With regard to how participation history influences the immediate effects of compensatory 
services provided in subsequent years, comparisons of the* achievement growth between 
current compensatory^eekication students who did and did not receive th$ services in a 
previous year reveals mixed results. There is some evidence showing that the immediate 
effects of compensatory services are enhanced by previous participation in the programs. 
However, there is also evidence indicating the opposite — the effects <jf current services are 
smaller for participants who repeat the programs than for those who are 'new' to the pro- 
grams. In many other cases, the data suggest that the effects of compensatory services in a 
" given year are not influenced by receipt of such services in an earlier year. In general, these 
findings are not substantially affected by the amount of instructional services. 

5. How are instructional sen/ices, school environment, and educational methods related to stu- 
dent's educational Weve/opment? 

Amourits of instruction, characteristics of instructional staff, school's environment, and 
teacher practices in the classroom together do not account for much of the variance of post- 
test scores. Analysis of the first-year data shows that the variations of posttest achievement 
among students are mostly attributable to their differences with respect to pretest achieve- 
ment and family background. The unique contribution of the whole set of these educational 
variables is small, suggesting that the educational process does not play a prominent role in 
explaining achievement growth. 

Concerning the relationships between achievement progress and specific dimensions of the 
educational process, the following findings are noteworthy: • 

• Among different kinds of instruction, amount of instruction by regular teachers in groups 
of seven or more students has positive effects on reading and math achievement, but 
such positive effects are not evident at all grades. This finding merely reconfirms the 
results explained in question 2 above. 

• Largely because of the policy of providing the special services primarily to low-achieving 
students, i. is difficult to detect any positive effects of the amount of instruction by special 
teaching staff or in small groups. Indeed, the relationship between amount of such 
special instruction and achievement growth sometimes remains negative after control- 
ling for preexisting differences among the students. 
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• Amount of independent seat-work or instruction by tutors occasionally demonstrates 
positive effects on achievement. 

• Among other manipulate aspects of the educational process, only the- teaching 
experience of the instructional staff consistently demonstrates a positive effect on 
achievement. 

• All other educational variables that have consistent influences on achievement reflect 
school's existing conditions that are not subject to changes through simple manipula- 
tions. For instance, students in schools having higher concentration of low-achieving < 
students tend to progress less during the school period. 

6. Are the characteristics of effective educational programs diffe ent by grade /eve/s? 

Few of the obviously manipulate characteristics of educational process (e.g., teacher's prac- 
tices) show consistent effectiveness in enhancing achievement at all grades. Moreover, there 
are few systematic and meaningful differences among grades with regard to the effects of 
- various educational dimensions. As a summary, discriminant analysis of two groups of 
students having relatively high and low g'rowth suggests a general picture of more effective 
programs: , % q ^ - m . + 

• Students are taught by more experienced teachers. 

V 

• Students receive more regular instruction by clessroom teachers in medium to large 
groups. \ 

• Students spend more time working with tutors or on study materials independently. 

• Students are more frequently provided with feedback concerning their progress. 

• . There are few disturbances of instruction caused by physical fights or violence. * 

7. Are the effects of various educational dimensions associated with student characteristics? 

No clear picture emerges from the analysis concerning what educational methods are most 
effective for different kinds of students. In reading, the few significant interactions between 
the effects of educational programs and student characteristics vaguely suggest that the 
educational aspects* emphasized by compensatory programs (such as parent/community 
involvement, inservice training for teachers) tend to be more beneficial to the achievement 
of students who are more likely to receive compensatory services (those who are poor and ♦ 
low achieving). While this abstracted finding is encouraging, there is not much confidence of . 
its practical meaning as each result is obtained only in an isolated grade. In math, most of the 
interaction effects involve school conditions that are determining factors for receiving com- 
pensatory funds; the few other interactions Iftat involve teacher's Characteristics (e.g., 
teaching experience) are weak and not shown in more than one grade. It is concluded that 
considerations of interactions with student characteristics do not substantially further our 
understanding of the relationships between the educational process and achievement. 

In addition, the discriminant analysis of two groups of compensatory-education students 
who are 'successful' (achieve better gains than expected) and 'unsuccessful' finds few 
specific characteristics of the programs that are particularly effective in improving the 
achievement of the deprived students but not that of other elementary students. It is 
suggested that further progress in this area of inquiry would require better data on home 
environment, teacher, and classroom behaviors. 
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CHAPTER 1. INTRODUCTION 

This chapter is intended to prepare the reader for a proper perspective ofth is report We 
review briefly the history of compensatory education, especially of Trt/e / oY (he E/emen- 
tary*and Secondary Education Act of 1965, leading to the Sustaining Effects Study. The 
sample and the data that constitute, the basii for this report are explained. The sample 
includes 328 schools; 242 of them constitute ajMtionallyrepresentative sample. The data 
come from the first year of the study jand consist of achievement scores, attitude measures, 
and information on student backgrounds, instructional, services, and educational pra 
grams. The purpose of this report is to assess the effects of compensatory services and 
examine the relationships between achievement growth and the educational dimensions. 
The data are analyzed with multiple approaches in order topreseht a comprehensive 'pic- 
ture of the current state of compensatory-education programs. u 

f • « • 

* 

The problem of data attrition, being a common concern in all analyses for this report, is 
* addressed mdhis'chapter. As achievement scores are some of the most critical data for this 
report, we focus the discussion on the rates of missing test scores and how they are related 
to student backgrounds. We also compare the achievement levels between students for 
whom we have both pretest and posttest scores and those for whom we have only one or 
the other. Overall, 9.4 percent of the students in the first-year sample have only pretest 
scores while 8.4 percent have posttest scores only. This leaves about 82 percent of students 
who have both pretest and posttest scores. By race/ethnicity, students of Spanish heritage 
have the highest rates offliissing'scores while non-Hispanic whites have the lowest. With 
respect to economic status, students from low-income families have greater rates of miss- 
ing scores than others. On the whole, there is a consistent tendency for those who are 
absent in one testing to achieve slightly lower than those who are present in both testings. 

In light of the pattern of missing data among students of different characteristics and the 
achievement differences between students with and without missing scores, there is a con- 
cern that the results of the analyses baseji on cases with complete data may be, to some 
extent, biased. However, becauie the missing-data rates are moderate and because stu- 
dent characteristics have been used to control for preexisting differences in assp« c, og 
growth, we expect the loss of information because of missing data to have little inttuence 
on the validity of our findings. \ 

In 1965, Congress passed the Elementary and Secondary Education Act (ESEA) that authorized 
federal funds to provide compensatory education (CE) to educationally disadvantaged students in 
schools with high concentrations of children from low-income families. The goal of Title I of ESEA is 
clearly stated in Section 101 of Public Law 89-10, 'Elementary and Secondary Education Act of 

1965;: 

\ 

i 

In recognition of the special educational needs of children of low-income families and the 
impact that concentrations of low-income families have on the ability of local educational 
agencies to support adequate educational programs, the Congress hereby declares it to be 
the po//cy of the United States to provide financial ass/stance fas set forth in the following 
parts of this title) to local educational agencies serving areas with concentrations of 
children from low-income families to expand and improve their educational programs by 
various means (including preschool programs) which contribute particularly to meeting 
the special educational needs of educationally deprived children. 

To ensure that Title I programs are effective in meeting this goal, the legislation specifically requires 
that the programs be evaluated regularly and the results reported to Congress. The Title I evaluation 
system, as envisaged by the Congress, was to collect data locally and aggregate them at the state 
level to form the States' Annual Evaluation Reports. The Office of Education (now the Department of 



Education) received the state reports and attempted to aggregate their data in order to establish a 
basis for a national evaluation. 



A desire to obtain further information beyond that in the state reports prompted^ fgu&aljgovern- 
ment to initiate independent evaluations of Title I. Earlier efforts includedJttfe ]EE^p6 Study 
(General Electric Company-TEMPO, 1967, 1971), two national sur^ys during the 1967-69 school 
years (Class, 1970), and an attempt to synthesize data from many diverse sources between 1965 and 
1,970 (Wargo, Tallmadge, Michaels, Lipe, and Morris, 1972). In general, these efforts found little 
evidence (Hat the Title I program had an overall positive impact on achievement. However, it was 
pointed out that data from some state and local agencies showed evidence of positive impact. 

^ In order to improve the quality of data for national evaluations, the Office of Education contracted 
with the Educational Testing Service in 1 971 to conduct the Compensatory Reading Study (CRS). For 
'the first time, standardized achievement tests were administered at approximately the same time to 
students from a large and nearly representative sample of schools. Although findings varied with the 
analytic methods employed, there were indications of positive effects within a single school year, 
particularly for students in the second grade. In cases where^no positive achievement impact was 
demonstrated, the results also revealed no evidence that compensatory reading students were fall- 
ing farther behind their non-CE peers in achievement (Trismen, Waaler, and Wilder, 1975; USOE, 
1976). 

While the results of the Compensatory Reading Study were encouraging, it has not been able to pro- 
vide a comprehensive picture of the effects of CE, as it involved only reading programs in grades 2, 
4, and 6. Other evaluations also were aimed primarily at examining the effects of Title I programs on 
reading achievement, with little attention paid to achievement in math. This favoritism to the 
evaluation of compensatory reading programs is a reflection of the greater emphasis of CE programs 
on improving reading skills, as those skills are essential for learning other skills and for success in 
later life. But such one-sided emphasis leaves us with little information about the effect of CE on 
math achievement. Thus, there was a need to study math CE programs and to involve all six elemen- 
tary grades on which Title I funds and efforts were concentrated. 

The Education Amendments of 1 974 (Public Law 93-380) added a new section to Title I to direct the 
U.S. Commissioner of Education to expand efforts to describe the actual and potential participants 
of Title I programs and to evaluate the effects of such participation. Prompted by this requirement 
and the interest in the long-term effects of Title I services, the U.S. Office of Education (now the 
Department of Education) planned a large-scale evaluation study of Title I but also concerning state 
and local compensatory-education programs. Through competitive procurement, System Develop- 
ment Corporation was then awarded a contract to conduct a five-year 'Sustaining Effects Study' 
(SES), beginning in July, 1975. 

The Sustaining Effects Study collected data from both a nationally representative sample and pur- 
posively selected samples for three consecutive years (1976-1979). The data-collection effort 
included both reading and math programs, and covered the six elementary grades. The study has 
thus established a comprehensive data base that allows analyses /equired to answermany of the 
questions about the effects of CE and the effectiveness of different'educational practices, as well as 
detailed descriptive analyses regarding the nature of the national CE effort and its participants. 

Most evaluation studies of the Title I ogram conducted before 1976 were reviewed in detail by the 
staff of the American Institutes for Research under <^>ntracts with the National Institute of Education 
in 1977. Findings have been summarized by Rossi, McLaughlin, Campbell, and Everett (1977) and 
synthesized by McLaughlin (1977); while the controversial issues surrounding the evaluations of 
CE and various aspects of sampling and methodological problems are discussed in McLaughlin, 
Cilmartin, and Rossi (1977). Referring to these documents, the reader could quickly learn about the 
inadequacies of the data, the less-than-definitive findings, ^nd many of the methodological pro- 
blems that plague survey evaluations. In a table summarizing evidence concerning the general 
effectiveness of CE, McLaughlin (1977) poinfed out that all studies were based on data of ques- 
tionable validity, and lacked a representative sample, with the exception of the Compensatory 
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\ Reading Study, The Staining Effects Study was designed to overcome marfy of the difficult^ in the 
*edrlier evaluations an«, at the same time, to allow information to be extracted to flid us Tn 
* understa^ding r some of the current controversial issues. 

• # . - ~ — 

- ^ For instance, oncf of the controversies about the long-terrneffecliven ess of CE has been that, despite 
evidence showing improvements for the CE students during the school year,' they appear to fall far- 
ther and farther behind their non-disadvantaged peers as they progress to higher grades. Many k 
explanations have been offered for these paradoxical findiggs.fcme attribute the falling-behind to 
losses over the sumrrfer f[homas and Pelavin, 1976; Pelavin and David, 1977). Some blame it on 
discontinuation of compensatory services just as the students begin to benefit from them (and 
become no longer qualified to receive them according to strict interpretations of guidelines, U.S. 
General Accounting Office, 1975)., However, these explanations were usually generated from 
flawe ; d»analyses. Thus, it is important that the longitudinal data of the Sustaining Effects Study <3re 
used to furnish information that may lead to resolution of such controversies. Table 1-1 provides a 
list of. shortcomings of previous evaluation studies and briefly describes how the design of the Sus- 
taining Effects Study attempted to overcome them so that the findings apd interpretations would be 
less questionable. ' * •* . 

Because the findings from the Sustaining Effects Study are intended to serve many evaluation pur- 
poses, we will first briefly describe the objectives of the study in the'next section. Then, the specific 
purpose, of this report will be noted in the context of the general objectives of the study. 

OBJECTIVES OF THE SUSTAINING EFFECTS STUDY 

The objectives of the study are implicit in the list of design improvements presented fti Table 1-1. 
The major objectives are discussed briefly below, along with references to the reports that address 
them. A summary of the findings in the completed reports can be found in the general introduction 
to the study. * - * 

K Description of Student Selection for CE as It Relates to Economic Status, Achievement: and Home 
Envirohment. The Education Amendments of 1974 required several studies to inform the Congress 
concerning the reauthorization of the Title I program in 1978. One of the major questions posed by 
the Congress was who received the services provided by Title I funds. Some members of Congress 
considered changing Title I to stress economic disadvantage less and educational disadvantage 
more in the distribution of funds to districts and schools. In the discussion of this issue, Congress 
wanted information on the following questions: 

• How many economically needy children are and are not selected for Title I services? 

• How many educationally needy children are and are not selected for Title I services? 

• ■ How is selection for Title I services related to economic and educational status of the 

students? 

In addition, the l-ederal Agency needed to know: 

• What kinds of educational services are received by the economically and educationally 
disadvantaged children that are different from those received by non -disadvantaged 
children? 

• How are selection for Title \ services and academic achievement related to the children's 
home environments, parents' participations in and awareness of their children's educations, 
and parents' satisfactions with the educational services their children receive? 

These questions were all addressed in Technical Reports 2 (Breglio, Hinckley, and Beal, 1978), 
3 (Hinckley, Beal, and Breglio, 1978), and 4 (Hinckley, Beal, Breglio, Haertel, and Wiley, 1979) 
from the Participation Si«h«tudy of the Sustaining Effects Study. 
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\ Table 1-1 

improvements in the Design of the Sustaining Effects Study in Order 
to Overcome, the Shortcomings of Previous Evaluations 



Shortcoming of Previous Evaluations 


How Shortcoming is Addressed in the SES 


Studies rarely followed students for r 
more than one year, so long-term or ■ 
copulative effects of CE could not 
be reflected in the findings. 


The'SES follows students, their* growth, 
and their educational services for 
three school years, and also collects 
information on summer experiences. 


Only certain grades were selected, so 
differential effects oyer the impor- 
tant early development years could 
not be determined. 


The SES sampled children in .all six of 
the elementary grades, maintains a large 
sample in each grade, and analyses data • 
separately by grade or cohort ., 



Schools and students were generally 
selected" for specific comparisons 
only, so descriptions of the national 
state of affairs could not be made 
with much accuracy. 



The SES has a nationally representative 
sample which has supported statistics 
projected to the national population 
with quite small sampling errors. 



Achievement growth measured in terms 
of national norms was very ques- 
tionable because of the unfounded 
assumptions on which the norms were 
interpolated and extrapolated. 



The SES developed its own norms, based 
on flail and spring test administrations, 
that do not depend on any testing-time 
interpolations or 'extreme-score norm 
extrapolations. 



Norms for the published achievement 
tests were based on samples that were 
"under-representative of the kinds of 
students likely to receive CE, cloud- 
ing the meaning of the findings. The 
items of the tests «ere sometimes 
suspected of being biased againrt 
those students. 



The SES norms were developed from the 
sample that was fully representative of 
poor, minority, urban, and low- achieving 
students. Test items were analyzed for 
racial/ethnic bias and were eliminated 
from the study and from the norms when 
found to be biased.- 



The relevance of the achievement 
tests to the lives of disadvantaged 
students was questioned as the real 
cause of poor performance 



The SES developed a new achievement 
measure that stressed relevance to the 
everyday lives of students .from a wide 
spectrum of conditions. 



Selection for receipt of CE was 
frequently equated with the actual 
receipt of supplemental or remedial 
=>services. CE was often considered 
as a single and uniform treatment. 



The SES collects information on selection 
for CE and receipt of instructional ser- 
vices independently, so their relation- 
ships can be empiricatty ^gfeudi edj Various 
CE treatments can be examined^^carately. 



Costs for educational services were 
based on district expenditure figures, 
with the assumptions that all students 
shared equally and that ail expendi- 
tures could be presumed to have direct 
effects on student growth. 



The SES develops cost estimates for 
each student, based on the direct 
instructional services and resources 
the student receives. Costs for such 
things as buildings and administration 
are not included. 

— : J 

The SES has many different and clearly 
definable comparison groups, so findings 
can be interpreted in light of the 
differences between the groups. 



Comparison students for those 
receiving CE were clearly very differ- 
ent in many respects, in addition to 
thfeir non-receipt of CE services. 



Measures of critical variables, such 
as socio-economic status, costs, 
achievement, an£ services were fre- 
quently analyzed at the school level, 
possibly masking effects at the 
student level. 

I 



The SES measures many of the critical 
variables at the student level , and 
aggregates the data when school-level 
indexes are needed. 
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Description of the Nature of CE Programs, Characteristics of Participating Students, Schools, and 
Educational Services. The Participation Study # dealt almost exclusively with what has been called 
'selection for CE or Title I services', without examining too closely vv^at such programs really are 
and how they differ from the programs regularly offered by the schools. In order to draw the rela- 
tionships between participation in a CE program and the educational progress of students, we must 
*be assured that there really is a distinct program that can be specified in some way, and has a 
reasonable chance of making an impact. As will be seen in the present report and in future reports, 
not only do we analyze data on the basis of program participation,, but we also consider the actual 
services received, irt order to address directly the possible differences between the intention jnd the 
actuality. Ba^ed on the analyses of data obtained frofn about 81,500 students in the representative 
sample, Technical Report 5 (Wang, Hoepfner, Zagorski, Hemenway, Brown, and Bear, 1978) pro- 
vides detailed descriptions of the nature and recipients of^omnensatory services. . * 

Evaluation of the Cost-Effectiveness of Compensatory Educatioi\. In its deliberations for 'the 
reauthorization of Title I and in annual appropriation hearings, Congress also wants to have infor- 
' .mation on the effectiveness of the program relative to its cost. While it appears eminently sensible to 
^ ask the question of cost-effectiveness, it is difficult to provide the answers in a manner that will be 
interpreted correctly. 

In the studyofcost--effectivenessofCF, efforts were made to preclude enigmatic conclusions and, at 
thg same time, to make cost estimates on a sounder basis than in the past. In Technical Report 6, 
Haggart, Klibanoff, Sumner, and Williams (1978) develop and present a model that translates educa- 
♦ tional resources for each student into estimates of average or standard dollar costs^for his/her 
instructional program. The model is thus called a resource-cost model, which results in a cost index 
designed to represent the labor-intensity of services without being confounded with regional price 
differentials, different accounting methods, etc. The report also compares services received by 
students in different CE programs in terms of the cost measure. * 

In Technical Report 7, Sumner, Klibanoff, and Haggart (1979) relate resource-costs to achievement 
growth in order to examine the cost-effectiveness of compensatory programs. 

Assessment of the Effects of Summer-School Programs. The study has also examined the result of 
attendance at summer schools, because of the interest of members of Congress and program 
administrators in knowing if such attendance prevents the presumed progressive achievement 
deficit of low-achieving students. In particular, there is a concern about the validity of the 'summer 
drop-off hypothesis which stipulates that there is a loss of learning during the summer recess, 
especially for low-achieving students. The effectiveness of summer schools and the hypothesis of 
'summer drop-off' are addressed in Technical Report 8 (Klibanoff and Haggart, 1980). 

/nve*t/gat/on of the Effects of Discontinuing Compensatory Services. Springing from the same con- 
cern to find an explanation for the presumed widening achievement gap, it has been hypothesized 
that strict conformance to rules and guidelines for CE programs, causing the discontinuation of CE 
services when students' achievement rose above their schools' cutoff levels for program participa- 
✓ tion, results in the students' losses of the gains attributable to the CE programs. 

For a clarification of this issue, it is important to learn what happens to students when their participa- 
tion in compensatory programs is discontinued. Whether the effects of CE are sustained and how 
services provided to students are changed after their compensatory services cease are studied in 
Technical Report 1 1 (Kenoyer, Cooper, Saxton, and Hoepfner, 1981). (The question 'what services 
are effective for sustaining the effects of CE after its discontinuation' will be addressed in a later 
report, Report 15.) 

Evaluation of Long-Term Effects of CE and Study of Effective Educational Processes. The present 
report and the reports yet to come from the Sustaining Effects, Study will address the effects of 
educational practices on raising student achievement levels, with special attention to the practices 
found in CE programs in general and in Title 1 programs in particular. The analyses in this report 
employ only the first-year data, while later studies of impact will either be basec on three-year 
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longitudinal data or will be based on interviews and in-depth observations of what happens in the 
classrooms* The extensive achievement data collected from overlapping cohorts of students in the 
three years will be utilized to describe the pattern of educational growth over the years for various 
groups of CE and non-CE students. The analyses of longitudinal data will allow us to examine further 
^ the sustained effects 0f CE and help us determine if the presumed phenomenon of gap-widening 
4 between "the disadvantaged and non-disadvantaged students indeed exists. 

THE PURPOSE AND OBJECTIVES OF THE PRESENT REPORT 

This report is based only on data from the first year of the study, that is, on information about ser- 
vices and educational progress for a nationally representative sample 6f students and for students 
from purposively selected samples. The students' educational development is examined to evaluate 
the effects.of compensatory services on both their achievement growth and attitudinal changes. 
Another objective is to study the relationship between educational development and amount of ser- 
vices received as well as characteristics of instructional programs. 

The assessment of students' achievement growth during the school year is an important part of the 
evaluation of compensatory education for many reasons, including the debate noted earlier about 
the pattern of growth over the summer (David and Pelavin, 1978). For example, in order to under- 
stand possible differences in the development process between the school-year period and the sum- 
mer period, a thorough examination of the effects of instruction on growth during the school year is 
necessary. What occurs in the school year can provide a baseline reference for assessing growth 
between the school years. 

There are four reasons for this report. First, using all the data obtained in the first year, (he findings 
are based on a nationally representative sample of schools and their students (because of funding 
limitations, the three-year longitudinal data base contains data from a reduced sample; see a later 
section for a description of the sample). 

The second advantage of analyzing the entire first-year is that the norms of achievement tests were 
established empirically using data collected that year from students in the representative sample of 
schools. (The norms created specifically for this study are referred to as the SES norms in this report.) 
This allows us to examine the achievement growth of different groups of students in comparison 
with the projected population growth for the same time interval. It should also be noted that there is 
an imoprtant difference between the norms we use and the traditional norms which the publishers 
provide: almost identical groups of students were tested in the fall and spring with two adjacent 
levels of tests to supply data for the construction of the norms. Such truly empirical norms are still 
lacking for some major tests. Besides, publisher's norms are seldom created in the same year as the 
data are collected for the evaluation, and thus may not represent the current population because of 
demographic changes. (There is a similar concern about the timeliness of the norms in the analyses 
of the longitudinal data from this study.) 

The third reason for this report is that the study serves as a guide for the later reports in the generation 
of hypotheses and selection of appropriate analytical approaches. Reasonable hypotheses can be 
formulated when potential rivals have been tested with the first-year data. In addition, approaches 
that were found to be particularly fruitful in these early analyses can i5e emphasized in the 
longitudipal study. Last, (he report provides results at an earlier date so that policy and decision 
makers Will have reliable preliminary findings prior to the final reports of the study. 

ISSUES AND QUESTIONS ADDRESSED IN THE REPORT 

The questions addressed in this report were formulated in response to the USOE's needs for infor- 
mation, the concerns'of the Title I program staff, and the advice from the Policy and Research 
Advisory panels convened for the study. The questions were originally stated in the context of the 
multi-year evaluation as follows: 

• Does compensatory education result in benefit to students' educational growth? 
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• To what extent do compensatory services narrow the achievement gap between disadvan- 
taged and non-disadvantaged students? 

• At what level of effort is narrowing of the gap detectable? 

• \ For various intensities and durations of participation, what grade levels profit most from com- 

pensatory services? , , w j 

• What kinds of services result in the greatest educational growth? 

• What. kinds of services are effective at different grade levels? 

• What kinds of students profit most from what kinds of services? 

Two major issues were addressed in these questions: the first four concern the effects of CE on 
reducing the anticipated educational deficit of its participants, and the last three deal with the rela- 
tionship between students' educational development and characteristics of educational processes. 

Questions derived from these study issues that guided the analyses for this report are listed below 
(these questions are formulated to emphasize specifically the confinement of the analyses to the 
one-year data): 

• During the school year, do CE students demonstrate greater educational development than 
expected of them without compensatory services? 

• Within a school year, do the instructional services delivered to CE students result in a reduc- 
tion of the anticipated achievement gap between them and non-CE students? 

• What is the critical level of effort for reducing this anticipated achievement gap? 

• Does compensatory education have greater effects on the participant's achievement growth 
at some grade levels than at others? Are the effects different for students who did and who 
did not participate a yeat earlier? And, does this pattern of differences vary with the amount 
of services provided? 

• How are instructional services, school environment, and educational methods related to 
educational development? 

• Are the characteristics of effective educational programs different by grade levels? 

• Are the effects of various educational dimensions associated with student characteristics? 

Answers for these questions are presented in the next seven chapters following the same order. 
Each chapter addresses one specific question and relates the findings to those in other chapters. 

i - 

PRESENTATION OF FINDINGS 

The remaining chapters of this report are divided into two parts, addressing two major issues: 

• Part i, The Effects of Compensatory Education and Instructional Services. * 

There are four chapters (2, through 5), discussing the effectiveness of CE in raising student 
achievement levels and in changing attitudes; the role of instructional services in effecting 
achievement growth; the critical amount of effort required to produce a noticeable reduc- 
tion in achievement deficits of CE students; and the differential effects of CE at different 
grades and for different previous experience with CE. 
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• Part II, The Relationships Between the Educational Process and Educational Development. 

There are three chapters (6 through 8), examining relations of educational development with 
m characteristics of educational processes and amount of instructional services; variations of 
these relations among grades; and interactions of student characteristics with effective 
practices. 

In the rest of this chapter, we describe the sample and the data that are analyzed in this report, 
examine how the attrition of data may affect the conclusions of our,' analysis, present a general 
discussion of the analytic approaches, and address some technical concerns. These materials are 
intended to prepare the reader for a better understanding of the analyses and help him/her see mat- 
ters in perspective. Without much loss of continuity, the readers who are anxious to learn the results 
may skip the subsequent sections and proceed to other chapters. While reading the report, the 
reader may oe confronted with the issues that are addressed in these sections and wish to return to 
this chapter for some discussion. Those who would rather have a preview of the issues before con- 
fronting them in the remaining chapters, may read the following sections entirely or selectively 
depending on their interests. 

For the benefit of those readers who would like to skip to the other chapters, we would advise them 
to become familiar with the achievement data for the students included in our analyses, as sum- 
marized in Tables 1-2 and 1-3, so that they can better understand the discussion of student growth. 
Additionally, we note that with regard to the problem of data attrition, it is concluded that the pro- 
blem is not serious (the rates of missing data are moderate) for the school-year analyses and, in 
general, is expected to have little influence on the validity of our results, 

DESCRIPTION OF THE DATA BASE AND ITS ORGANIZATION 

/ 

The Sample, The data that support this report come from the complete first-year sample of the SES 
(see Technical Report 1, Hoepfner, Zagorski, and Wellisch, 1977, for a detailed description of the 
selection of these samples). The complete sample actually consists of four different samples. The 
first and largest sample is the nationally representative sample consisting of 242 schools (about 
83,500 students) selected on a stratified-random basis so that data from districts, schools, and 
students can be accurately projected to the national population. a 

Twenty-nine schools belong to the comparison sample (about 12,000 students), a sample pur- 
posively selected to supply an adequate number of schools that have no CE programs but serve 
large numbers of students from low-income families. Because of the wide availability of CE pro- 
grams, such schools are not common, but their students provide a very important comparison 
group for CE students: their low-achieving students are in need of special assistance but are not pro- 
vided with compensatory services, nor is there any possibility that they might indirectly benefit from 
'spillover 7 of such services provided to other students in the schools. 

A third sample comprises 14 'feeder/feed' schools that enroll about 5,000 students who either have 
attended or will attend schools in the representative and comparison samples. This extra sample 
was necessitated by the fact that some schools with grades in the 1-6 range serve only a restricted 
range. of grades, and receive students from or send them to other schools to complete the six 
elemaoiajy grades. Inclusion of this sample enables the study to follow those students who transfer 
to. other schools because of the restricted range of grades in their schools. 

A fourth sample is composed of 43 schools (about 20,000 students) nominated as exemplary CE 
schools. These schools generally have a high enrollment of poor students who participate in CE, an d 
their CE programs have been recommended as being innovative and promising in raising achieve- 
ment. The purpose of this sample was to ensure the inclusion of schools that had good chances of 
demonstrating the effectiveness of CE programs. 

All 328 schools provide data for at least some of the analyses presented in this report. 
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Table 1-2 / 

Reading Achievement Scores for the First-Year 
Sample by Availability of the Fall and Spring Scores 



Sampling status 
of Schools* 

Availability 
of Scores** 



Entire Sample 



Representative 
Schools*** 



Comparison 
Schools 



Nominated 
Schools 



Fall and 
Spring 



Fall or 
Spring 



Fall and 
Spring 



Fall or 
Spring 



Fall and 
Spring 



Fall or 
Spring 



Fall and 
Spring 



Fall or 
Spring 



Grade 1 



Fall 


N 
Mean 
S*D. 


16,893 
344.41 
33.37 


2,563 
334.57 
33.06 


11,839 
147.25 
32.99 


1,809 * 
136.22 
33.17 


1,722 
339.04 
33.97 


279 
331.72 
33.30 


3,095 
336.07 
32v51 


442 
329.13 
31.18 


Spring 


N 

Mean 
S.D. 


16,893 
409.15 
46.23 


2,289 
394.43 
45.92 


11,839 
412.54 
46.13 


1,547 
396.64 
45.81 


1*722 
401.29 
44.84 


308 
395.24 
49.13 


3,095 
400.00 
45.79 


415 
384.98 
42.65 


Grade 2 




















Fall 


N 
Mean 

S*D. 


15,545 
415.55 
49 .'89 


2U10 
401.71 
50.53 


10 , 809 
420.25 
50.00 


1,433 
403.95 
51.48 


1,641 
411.33 
47.91 


215 
399.80 
45.59 


2,887 
399.37 
' 47.27 


418 
393.50 
49.61 


Spring 


N 
Mean 
S.D. 


15,545 
458.58 
53.10 


1,887 
443.32 
52.50 


10 , 809 
463.80 
53.68 


1,225 
445.96 
53.63 


1,641 
450.79 
49.33 


281 
449.93 
45.27 


2,887 . 
442.26 
49.48 


346 
426.71 
50.76 


Grade 3 




















Fall 


N 
Mean 
S.D. 


15,406 
459.72 
55.07 


1,923 
442.13 
54.58 


10,834 
464.49 
55.13 


1,241 
445.05 
55.53 


1,512 
454.02 
51.29 


227 
444.50 
50.51 


2,850 
443.60 
53.54 


391 
429.36 
53.59 


Spring 


N 

Mean 
S.D. 


15,406 
493.26 
56.92 


1,796 
476.15 
55.53 


10,834 
498.14 
57.27 


1,193 
481.71 ' 
55.99 


1,512 
483.57 
50.74 


260 
472.27 
45.20 


2,850 
478.53 
55.36 


322 
457.80 
57.87 


Grade 4 




















' Fall 


N 

Mean 
S.D. 


15,470 
492.82 
62.16 


1,747 
474.38 
62.52 


10,671 
499.01 
62.35 


1,196 
475.88 
62.72 


1,*650 
481.68 
59.01 


185 
476.03 
60.10 


2,550 
474.13 
v 57.84 


331 
469.40 
62.59 


r Spring 


N 

Mean 
S.D. 


15,470 
522.52 
63.74 


1,572 
505.05 
61.66 


10,671 
527.97 ' 
63.52 ' 


1,066 
508.60 
63.11 


1,650 
514.53 
60.52 


208 
498.64 
56.26 


. 2,550 
/ 504 . 29 
62.00 


269 
494.88 
60.03 


Grade 5 




















\ 

\ 

\ Fall 


N 

Mean 
S.D. 


16,250 
523.31 
65.42 


1,676 
502.64 
67.68 


' 11,037 
530.05 
65.58 


1,102 
505.31 
67.75 


1,579 
516.68 
61.02 


188 
508.41 
63.49 


2,382 
501.93 
62.12 


279 
493.23 
69.84 


Spring 


N 

Mean 
S.L. 


16,250 
550.44 
69.37 


1,466 
530.08 
66.79 


11,037 
557.43 
69.86 


972 
535.34 
68.90 


1,579 
545.27 
61.88. 


154 
530.24 
60.68 


2,382 
527.42 
65.61 


246 
510.33 
59.03 


Grade 6 




















Fall 


N 

Mean 
S.D. 


18,739 
555.22 
69.55 


1,668 
533.30 
69.49 


13,331 
562.79 
68.56 


1,083 
537.71 
70.7^0 


1,367 
541.76 
69.09 


197 
537.01 
60.27 


2,041 
528.40 
66.42 


198 
516.89 
63.44 


Spring 


N 

Mean 
S.D. 


18,739 
580.29 
72.18 


1,460 
556.89 
70.78 


13,331 
588.07 
71.34 


959 
563.86 
71.12 


1,367 
567.22 
69.85 


146 
543.10 
65.31 


2,041 
554.11 
68.45 


173 
-538.82 
70.72 



r 

ERIC 



The sample of students in the Feeder Schools was not tabulated because of the small number 
of students. Thus, the N's for the Representative, Comparison, and Nominated Schools do 
not add up to the N for the entire sample. 

'* 

The 'Fall or Spring* heading indicates the group with fall scores but no .spring scores 
where fall achievement is described, while it indicates the group with spring scores but 
no fall scores where spring achievement is described. 

* 

The national projections give means very close to those shown here for the group of students 
-in Representative Schools who have both fall and spring test scores. Please refer to 
Table 1-12 of SES Technical Report 9 for the national projections. 



- Table 1*3 * 

Math Achievement Scores for the First-Year 
Sample by Availability of the Fall and Spring Scores 



Sampling Status 
of Schools* 

Availability 
of Scores** 



Entire Sample 



Fall and 
Spring 



Fall or 
Spring 



Representative 
Schools*** 



Fall and 
Spring 



Fall or 
Spring 



Comparison 
Schools 



Fall and 
Spring 



Fall or 
Spring 



Nominated 
Schools 



Fall and 
Spring 



Fall or 
Spring 



Grade 1 



Fall 



Spring 



N 


16,858 


2,551 


Mean 


330.85 


322.52 


S.D. 


35.68 


36.52 


N 


16,858 


2,292 


Mean 


392.38 


379.06 


S.D. 


45.24 


45.16 



ll{815 1,789 

333.51 • $23.86 

35.03 ' 36.35 

11,815 1,562 

394.86 381.28 

44.92 44.20 



1,716 


284 


3,090 


445 


323.73 


320.74 


323.75 


318.09 


37.20 


38.65 


a&.ib 


35.13,, 


1,716 




M 3,090 


409 


384.20 


377.65 


387.41 


370.69 


44.80 


49.81 


45.53 


43.27 



'St' ' 




Spring 



15,5*3 2,082 

392/73 379.80 

45.32 44.84 

15,513 1,892 

448.01 432.84 

51.67 50.75 



10,791 
396.71 
45.01 

10,791 
452.62 
51.11 



1,415 
382.10 
45.10 

1,228 
435.67 
50.03 



1,638 
388.70 
42.94 

1,638 
441.27 
51.34 



206 
377.74 
42.18 

285 
436.31 
52.15 



2,876 
379.64 
45.58 

2,876 
434.35 
51.64 



417 

372.98 
45.87 

346 
418.88 
50.70 



Grade 3 




















Fall 


N 
Mean 
S.D. 


15 , 390 
443.13 
49.91 


1,925 
429.05 
52.46 


10,815 
446.82 
48.85 


1,253 
432.47 
52.88 


1,522 
437.50 
50.84 


222 
428.64 
49.01 


2,843 
431.64 
51.67 


386 
418.37 
50.68 


Spring 


N 

Mean 
S.D. 


15,390 
500.36 
57.81 


1,790 
484.09 
58.27 


10,815 
505.78 
57.35 


1,191 
489.80 
58.06 


1,522 
489.45 
55.62 


253 
479.20 
52.20 


2,843 
483.97 
56.24 


326 
464.76 
58.86 


Grade 4 




















Fall 


N 

Mean 
S.D. 


15,431 
494.67 
60.44 


1,761 
477.41 
62.28 - 


10,639 
500.17 
59.49 


1,210 
480.27 
62.44 


1,647 
484.81 
57.78 


187 
473.48 
60.02 


2,546 
477.68 
61.06 


320 
469.50 
63.09 


Spring ' 


N 

Mean 
S.D. 


15,431 
544.85 
65.72 


1,572 
527.98 
64.61 


10,639 
550.17 
65.49 


1,054 
533.25 
64.83 


1,647 
537.96 
64.54 


207 
523.16 
63.09 


2,546 
526.85 
63.79 


270 
511.34 
62.62 


Grade 5 




















Fall 


N 

Mean 
S.D. 


16,234 
539.26 
65.22 


1,673 
517.38 
66.62 


11,022 
545.37 
64.72 


1,105 
521.19 
65.10 


1,588 
534.01 
62.56 


180 
515.74 
69.82 


2,376 
520.32 
66.26 


280 
506.48 
71.48 


Spring 


n' 
Mean 
S.D. 


16,234 
583.49 
73.52 


1,455 
564.43 
68.88 


11,022 
590.58 
73.76 


968 
569.46 , 
70.15 ' 


1,588 
579.15 
71.57 


147 
560.68 
67.23 


2,376 
562.06 
69.91 


246 
547.65 
65. ^8 


Grade 6 




















Fall 


N 
Mean 
S.D. 


18,699 
581.81 
69.95 


1,663 
559.32 
71.00 


13,305 
587.91 
68.94 


1,081 
561.99 
68.72 


1,359 
572.92 
68.45 


201 
563.73 
69.05 


2 ,040 
560.72 
70.01 


187 
549.89 
72.68 


Spring 


N 
Mean 
S.D. 


18,699 
621.70 
77.99 


1,471 
598.37 
75.03 


13,305 
627.59 
77.71 


- 968 
604.86 
74.76 


1,359 
614.82 
77.40 


146 
589.35 
78.87 


2,040 
602.70 
73.94 


178 
586.94 
76.05 



*The sample of students in the Feeder Schools was not tabulated because of the small number 
of students. Thus, the N*s for the Representative, Comparison, and Nominated Schools do 
not add up to the N for the entire sample. 

**The 'Fall or Spring 1 heading indicates the group with fall scores but no spring scores 
where fall achievement is described, while it indicates the group with spring scores but 
no fall scores where spring achievement is described. 
***The national projections give means very close to those shown here for the group of students 
in Representative Schools who have both fall and spring test scores. Please refer to 
Table 1-12 of the SES Technical Report 9 for^the national projections. 
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The Organization of the Data Base. The data base is organized at the student level. Data at the 
teacher, classroom, or school level were then disaggregated to the student level, with the full 
realization of the effects of this approach on the estimates of variance of the disaggregated 
measures. The data were extracted from all the first-year instruments (Hemenway, Wang, Kenoyer, 
Hoepfner, Bear, and Smith, 1978). (Sample copies of the instruments not under copyright are 
reprinted in Report 9A, The SES Project Staff, 1979.) As a review, we briefly describe, in the follow- 
ing paragraphs, the measures that are used in the analyses for this report. 

Outcome Measures Describing Students' Educational Development. Three measures belong to the 
category of student outcomes-the results by which educational programs are frequently.evaluated. 

The Comprehensive Tests of Basic Skills (CTBS), Form S, was administered to each student in the 
sample, both in the fall and the spring of the school /ear. Because many of the students in the sam- 
ple are low achievers (schools were selected by strata to ensure that such students, eligible for CE 
services, were included in sufficient, numbers), each student was administered two levels of the 
CTBS: the one prescribed by the publisher as appropriate for each grade and another one level 
below. In this manner, we could select test data that were not from a test too difficult for the 
students. In the analyses of this report, we use primarily what we have termed the 'recommended 
level' of the CTBS (the one that resulted in smaller floor and ceiling effects for each grade in each 
school), but at times data from both of the levels are required for the analyses. 

Subscales oi r the CTBS were selected to provide indexes of achievement in reading and in math. 
Because we had obtained good national data from the representative sample and because most 
children provided scores from two adjacent levels of the test, we created norms and vertical scale 
scores (VSSh These norms and scales served the additional advantage that they provided test-score 
conversions that did not under-represent students who are poor, low-achieving, or minority, as was 
sometimes the case in publishers' standardization samples. In addition, both fall and spring norms 
were based on empirical test scores at all grades, and not on extrapolations or interpolations. (See 
Hemenway et al., 1978 for details of the procedures for creating norms and VSSs.) 

Because CE students are largely from minority groups, and from families of low economic status, it is 
important to remove any possible socio-cultural biases in the test employed in the evaluation. The 
publisher of the CTBS had carried out a study to eliminate items that werp judged as possibly biased. 
Nevertheless, in order to ensure that the potential bias against disadvantaged and minorrty students 
was minimized, SDC also conducted an independent dcbiasing study. The study identified eight 
items from the reading subtests as being statistically and culturally biased. Each test was then 
rescored by omitting these biased items to obtain the so-called 'debiased score'. For this report, 
only the debiased scores are used in the analyses. 

In response to the concern about the relevance of standardized achievement tests, especially for 
poor, low-achieving, or minority students, the study also administered to students in grades 4, 5, 
and 6, in the fall and spring, a Practical Achievement Scale (PAS). The PAS presents students with 
pictorial items of everyday relevance that measure ability to solve problems requiring both reading 
and math skills. Because the test is relatively short (30 items) and because only one level was 
developed, the raw scores are employed in the analyses. 

TSe third measure of outcome is the Student Affective Measures (SAM), a test of attitudes toward 
reading, math, and school in general. This measure was included in order to assess what effects CE 
programs might have on students' attitudes, because many believe that changes in attitudes may be 
the initial and important outcomes of such programs. The SAM, like the CTBS and PAS, was 
administered in both the fall and spring of the school year, (Students in grade 1 were not 
administered the SAM in the fall, because their attitudes were expected to be formed mostly by 
preconceptions.) Students in grades 1 through 3 were administered a primary version and students 
in grades 4 to 6 were administered an intermediate version. The intermediate version was parallel to 
the primary, except that items addressed the more academic aspects of reading and math that ihe 
students were engaged in, instead of the simple activities or the primary form. 
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Measures of Instructional Services Received by the Students. Three measures of the receipt of instruc- 
tional services were obtained for each student. The Student Participation and Attendance Record- 
Reading (SPAR) and the Student Participation and Attendance Record-Math (SPAM) were com- 
pleted by teachers for each of their students four times during the school year. For each administra- 
tion of the SPAR and SPAM, which was to cover a two-month period, the student's reading and/or 
math teacher(s) estimated the percentage of the student's reading (or math) instructional time that 
was spent in groups of various sizes and with various kinds of instructional personnel during a 
typical week. The teacher also provided the total number of hours the student participated in 
reading (or math) instruction during the record week. 

The number of hours during the week was then multiplied by the number of weeks to provide a 
total number of hours for the two-month period, which was in turn adjusted by the students' atten- 
dance records and reports of unusual occurrences (such as snow storms, epidemics, etc.) that 
reduced instructional time. The bimonthly totals were then further adjusted for the length of the 
school year that was reported by the principal. The total hours could then be multiplied by the 
weighted average of the percentages of time in each of the ten instructional arrangements to obtain 
the total number of hours per year that each student spent in each arrangement. In this report we 
occasionally analyze instructional time under each of the ten arrangements. However, for the sake 
of simolicity and based on previous findings that some arrangements differentiated CE students from 
others (see Technical Report 5), we frequently group the instructional arrangements into only three 
types that are conceptually distinct (see later chapters for descriptions of these composites). 

The third measure of instructional services b the Summer Activity Slipsheet (SAS), completed by all 
students in grades 2 through 6. The scores from this instrument reflect the amounts of intellectual 
experience the student has had during the previous summer in reading and in math. The scores are 
heavily weighted by attendance at summer school where there was instruction in reading or math, 
but also give some consideration to other activities that engaged the children's minds in intellectual 
activities. 

Measures of Student Chaiacteristics. The Student Background Checklist (SBC) was completed for 
each student by his/her homeroom teacher. This instrument collects demographic and past- 
experience data on each student. Information from the SBC that is used in this report includes each 
student's race/ethnicity, early-childhood schooling experience, participation in free or reduced- 
price meals, previous CE receipt, parents' educational attainments, judged need for CE, and paren- 
tal involvement in child's education. For the first year, this instrument was completed between late 
October and early November. 

Selection for Compensatory Services The instrument critical for the categorization of students into 
the various analysis groups is the Compensatory Education Roster (CER). This instrument was com- 
pleted in the winter and updated in late spring by the coordinator at each school, and provided 
binary information on each student's selection for several kinds of compensatory services. The 
• responses on the CER were partially ^validated, against information obtained from the school prmci- 
paland from the district. For instance, if both the principal and the district business manager indi- 
cated that a specific program did not exist in the school, then false responses of receiving CE under 
the program were erased. Because all our analyses are performed separately for reading and for 
math and because ihe major CE distinctions are Title I, Other-CE, and no CE (modified by school 
receipt of CE to account for within-school 'spillover' effects), the responses from the CER are scored 
to reflect these groupings. 

Resource-Cost Data. The instructional servites measured by hours, supplemented by the amount of 
usage of various materials and equipment, were translated into resource-costs, as descnoed in 
Technical Report 6 (Haggart et al., 1978). The weighted composite of serv.c JJ^S^^^ 
to provide sensitive discriminations among students who received different kinds of compensatory 
services (see Technical Reports 6 and 11), and was also used in this report. 
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Demographic Information. Where the analyses require information on demographic characteristics 
of the schools, such as region and urbanism, these data were taken from the sampling files used in 
creating the sample of the schools (see Technical Report 1). 

Data Describing Schools. Some analyses in this report use school characteristics as independent 
variables or as grouping variables. Most of these variables are composites developed from i'-ms in 
the Principal Questionnaires (PQA and PQB), and in the Teacher Questionnaires (TQA, TQB, and 
TQC). Other school-level variables are obtained by aggregating student-level data, e.g., school's 
minority concentration arid poverty concentration. 

Data at the Teacher Level. Teachers completed, when appropriate, one questionnaire about their 
reading instruction (Teacher Questionnaire B, TQB),.one questionnaire about their math instruction 
(Teacher Questionnaire C, TQO, and one about themselves (Teacher Questionnaire A, TQA). As in 
all cases in this report, the reading and math information are kept separate and analyzed with their 
respective outcome measures. Teacher-level data are often disaggregated to the students. In cases 
where a student has only one teacher (the majority of cases, see Technical Report 9), the disaggn 6 
tion is a simple jnatter. But many students receive reading and/or math instruction from more t ^ 
*one teacher. The responses from the first-named and second-named teachers on the Student- 
Teacher Linkage Record (STLR) were averaged prior to disaggregation to their students, as there was 
no accurate way to weigh the teacher's responses differentially. Because less than 3 percent of the 
students received instruction from a third-named teacher in either reading or math, data from third- 
named teachers were not included in the disaggregated averages. (It was assumed that third-named 
teachers did not spend much time with those students for whom they were third-named.) 

For this report, most analyses consider only composites from the items in the teacher question- 
naires, which are described in Technical Report 9. In general, the composites characterize 
'qualifications' of teachers and their 'classroom instructional practices'. 

>> ' 

Appendix A1 provides a list of all the variables contained in the data base for this report, and the 

instruments from which they come. Note that some of the variables listed do not appear in the 

report— they were included for preliminary analyses (that are not reported) in the anticipation that 

they would prove useful. H 
♦ 

THE PROBLEM OFINCOMPLETE DATA (ATTRITION. DURING THE SCHOOL YEAR) 

An inevitable problem for survey studies is that data are missing for various reasons for some of the 
cases being studied. Missing data may threaten the internal validity of the analyses (Campbell and 
Stanley, 1966). There are two aspects of the effects of incomplete data that are important in the 
anaJyses. First, missing data not randomly distributed throughout the cases can bias the estimates of 
sample statistics and population inferences. Attempts to reduce this bias through Bayesian imputa- 
tion cf data have been investigated (Rubin, 1977, 1978). Second, the usable data themselves can be 
affected in multivariate analyses because if one or more Critical data points are missing, the entire 
case is usually deleted from the analysis. Methods have been developed for estimating the complete 
data variance-covariance matrices that are the basis for multivariate analyses, so that the effects of 
the missing data are minimized or eliminated (Afifi and Elashoff, 1966, 1967; Timm, 1970; Gleason 
and Staelin, 1975; Frane, 1976). 

For this report, where the emphasis of the analyses is to learn the relationships between achieve- 
ment and educational variables, rather than to describe populations, the problem of missing data is 
not expected to be very serious in distorting the data structure. Although techniques for estimating 
variance-covariance matrices or correlation matrices when some cases have incomplete data are 
available, they are generally used when sample sizes are small and missing data will reduce the N 
drastically so as to render all estimations quite biased (ste references cited above). In view of the 
large amount of data available for the present analyses and the carefpl quality control and imputa- 
, tion of missing responses, wherever appropriate,, frofn other responses on both logical and statistical 
bases (see Technical Report 9), we have not adopted any further imputations or corrections for 
missing data in our analyses. 



Nonetheless, in order to assess the seriousness of missing data and their effects on the results of our 
analyses, we prepare tabulations of attrition rates by student characteristics, and describe the 
distributions of important measures (such as achievement scores) for groups of students who supply 
various amounts of data. (See Trismen et aL, 1975; and Molitor, Watkins, and Napior, 1977 for 
examples of similar ways to deal with the problem of missing data.) In addition, Zagorski, Jordan, 
and Colon (1981) examine the attrition of data in the first yf *r and a half of the study. Their results 
may be consulted to obtain a general picture of the problem jf attrition in this study. However, we 
note that these results need not be appropriate for the present report as the nature of student attri- 
tion between school years is quite different from that within the school year and the attrition rate 
over the summej is usually much higher than during the school year. On the whole, the problem of 
attrition is expected to be more serious in the multi-year analyses than in this report. 

Missing Data for Achievement Scores 

Tables 1-2 and 1-3 present tabulations of CTBS score grade and by sample. The mean scores for 
.groups with missing data (fall or spring) are lower in all cases than the corresponding means for 
groups with complete data (fall and spring), but the standard deviations (s.d.) for both groups 
remain large and near the population values reported in Technical Report 9. In each case, the 
difference between group means is about or less than .3 standard deviation for the complete-data 
group. Therefore, it is safe to conclude that the score distributions for the groups with missing and 
with complete data are extensively overlapped. The groups with incomplete test data are n ot con- 
centrated in a narrow score range. • JT 



la pacing, it may be noted that the means and standard deviations for the complete-data group in 
the representative sample are about identical to the nationally projected values presented in Table 
1-12 of Report 9. This indicates that the unweighted data approximate those in the population quite 
well, even after the exclusion of cases with incomplete data. These tables also show that the average 
^cores for students in the nominated sample and for those in the comparison sample are always 
lower than the projected population means, while the corresponding standard deviations are quite 
similar to those for the population. The lower achievement levels for the students in the purposive 
samples are expected in light of the sampling criteria (see Report 1 for these criteria). 

Based on the first-year representative sample of schools, the percentages of students having both fall 
and spring scores range from 78 to 87 for read ing and for math, and increase with grade level. For all 
six grades combined the percentage is 82.2 for reading and for math (see the first row of Table 1-4). 
In total, 9.4 percent have only fall scores and 8.4 percent have only spring scores. These per- 
centages are similar to the 10 percent missing for each of the pretest and posttest scores reported in 
the Compensatory Reading Study (CRS). They also compare well to the principals' estimates cf 
mobility, indicating that, during a school year, 9.1 percent of the students move into the school's 
attendance area and 8.4 percent move out (see Technical Report 9). 

Missing Data for Other Student-Level Measures 

Table 1-5 provides counts of missing data for the Student Background Checklist (SBC), Com- 
pensatory Education Roster (CER), and Student Participation and Attendance Record in reading and 
math (SPARM), along with rates of missing data from th e entire first-year sample. It can be seen that 
the CER has the lowest rate of missing data (3.30 percent overall), while the SPARM has the highest 
rate (6.88 percent overall). For all three instruments, as well as for the CTBS scores, the rate of miss- 
ing data is greater in the early grades and decreases in the higher grades. 

The Relationship Between Student Characteristic, nd Missing Achievement Data 

Cf Status. Mean<s and standard deviations of CTBS scores for students with complete and with some 
missing data are presented in Tables 1-6 and 1-7, by CE category. To the extent that the statistics are 
similar for the two groups, the achievement distributions are also similar and the missing-data group 
can be assumed to be random with respect to achievement. On the other hand, substantially 




different statistics, indicating that the group with missing data has different achievement, would sug- 
gest that analyses based only on the cases with complete data are likely to produce misleading 
conclusions. , * ~ 



Table 1-4 

\ Percentages of Complete and Missing Reading and Math Scores 
From the Representative Sample for the First Year, by Grade 



• 

Avaiiaoi j.xty or o cores 


1 




Grade % 






Total 


1 


2 






5 


6 


















Fall and spring scores 


j 77.9 


80.3 


81.7 


82.5 


84.2 


86.7 


82.2 


Fall scores or*!y 


11.9 


-10.6 


9.4 


9.2 


8.4 


7.0 


9.4 


Spring scores only , 


. 10.2 


9.1 


9.0 


8.2 


7.4 


6.2 


8.4 


Total 


100.0 


100.0 


100.1 


99.9 


100.0 


99.9 


100.0 






Math 












Fall and* spring scores 


77.9 


80.3 


§1.6 


82.4 


84.2 


86.7 


82.2 


tall scores only ' 


11.8 


10.5 . 


9.5 


9.4 


8.4 


7.0 


9.4 


Spring scores only 


10.3 


9.1 


9.0 


8.2 


7.4 


6.3 


8.4 


Total 


100.0 


99.9 


100.1 


100,0 


100.0 


100.0 


100.0 



Table 1-5 



Number of Cases and Missing Data Rate for Student Background Checklist (SBQ, 
Compensatory Education Roster (CER), and Student Attendance 
Record in Reading and Math (SPARM) 



Grade 



SBC 



CER 



SPARM 



Number Percent Number Percent Number Percent 



Total Number 
of Records 



1 


1,380 


6.33 


835 


3.83 


1,710 


7185 


21,789 


2 


1,207 


6.17 


706 


3.61 


1,559 


7i97 


19,566 


3 


1,134 


5.92 


664 


3.47 


1,357 > 


7.08 


19,161 


4 


1,059 


5.63 


580 


3.08 


1,222 


6.49 


18,826 


5 


1,035 


5.33 


600 


3.09 


1,241 


6.39 


19,424 


6 


1,084 


4.95 


596 


2.72 


1,217 




21,899 


All 


6,899 


5.72 


3,981 


3.30 


8,306 


6.88 \ 


120,665 



15 

52 



Table 1-6 

Reading Achievement Scores for the First-Year Sample by 
Availability of the Fall and Spring Scores and Reading CE Status 



CE» St#tu« 



Tit 1« Z Studantt 
in Titla Z Schools 



Othar-CE Studantt 
in Titla Z Schools 



CE Studantt in 
Othar-CE Schools 



Non-CE Studantt Non-CE Studantt in 
in Titla Z Schoolt Othar-CE School* 



Studantt in 
Non-CE Schoolt 



^ Availability 
u of Scoraa* 


Pall and 

Spring 


Pall or 

Spring 


Fall and 

Spring 


Pall or 

Spring 


Pall and 

Spring 


Pall or 

Spring 


Fal 1 and 
Spring 


Fall or 
Spring 


Fall and 
Spring ^ 


s i° r 
pr ng 


Fal 1 and 
Spring 


Fall or 
Spring 


Crada 1 












r 




















H 


2,785 


238 


987 


99 


574 




63 


7, 140 


1,325 


3,238 


497 


2,151 


321 


Fall 


Mtan 


323.89 


" 321.17 . 


337*27 


333.47 


333.06 


Hi 


70 


348.53 


333.64 


357.96 


344.14 


342.51 


335.25 




S.O. 


28.94 


28.49 


30.08 


t 32.48 


35.01 




34 


32.02 


32.43 


31.26 


32.75 


33.32 


35.63 




H 1 


2,785 


264 


, 987 


^5^,107 


574 




55 


7,140 


631 


3,238 


256 


2,151 


174 


Spring 


Mtan 


383.12 


375.42 


396.86 


383.29 


390.24 


388 


53 


416.17 


395.45 


423.60 


409.16 


408.50 


407.77 




S.O, 


'40.55 


39.26 


44.70 


45.57 


46.32 


49 


19 


44.19 


45.62 


45.81 


48.26 


44.64 


44.55 


Crada 2 
































N 


3,036 


181 


948 


98 


704 




76 


6,027 


1,095 


2,842 


373 


1,954 


262 


rail 


Mtan 


380.80 


366.23 


405.55 


387.68 


387.86 


382. 


68 


426.33 


403.34 


441.83 


423.36 


413.40 


400.71 






38.05 


41.52 


47.19 


53.88 


43.85 


41 


98 


46.43 


49.68 


46.55 


48.89 


48.49 


45.81 




Main 


3,036 


218 


948 


88 


704 




38 


6,027 


526 


2,342 


206 


1,954 


168 


Spring 




423.48 


406.74 


446.86 


429.49 


433.82 


425. 


50 


469.54 


447.65 


485.24 


468.77 


455.56 


453.10 




sf. 


42.71 


44.65 


5K61 


52.57 


46.95 


38 


08 


50.44 


51,70 


48.27 


45.6,7 


50.97 


45.54 



Pall 


1* 

Mtan 

/S.D. 


3,022 
415.60 
41.08 


196 
407.04 
43.61 


884 
442.53 
54.01 


63 

425.55 
56.02 


629 
426.70 
49.92 


57 

436.03 
47.16 


5,977 
474.05 
46.93 


923 
441.94 
59.83 


2,927 
486.71 
49.65 


360 
462.64 
52.36 


1,936 
461.71 
54.63 


276 
447.96 
46.97 


/ Spring 

/ 


/ " 
/ Mtan 

7 S.D. 


3,022 
450.91 
42.85 


' 174 
432.66 
52.30 


884 
473.09 
54.87 


62 

447.65 

57.69 


629 
463.26 
. 51.35 


i9 

452.64 
46.76 


5,977 
506.30 
51.36 


510 
479.92 
55.35 


2,927 
522.03 
52.72 


221 
494.77 
44.65 


1,936. 
494.93 
56.74 


170 
462.00 
49.16 


Crada 4 




























Pall 

t 


N 

Maan 

S.O. 


2,392 
439.88 
43.66 


114 
431.33 
41.25 


864 
463.78 
58.08 


4S1.67 
59.76 


619 
455.56 
53.10 


34 

446.09 
47.55 


6,452 
506.05 
55. 30 


946 
** 471.35 
61,25 


3,172 
520.12 
59.17 


372 
499.13 
62.01 


1.955 
494.21 
61.92 { 


185 
479.53 
64.17 


* "Spring 


N 

Mtan 

S.O. 


2,392 
471.23 
* 47.01 


*«« 

469.17 

£1.16 


864 
492.25 
62.96 


59 

475.27 
•71.37 


* 619 
464.92 
55.06 


20 

460.70 
53.34 


6,452 
535.51 
56.11 


510 
507.87 
56.17 


3,172 
546.87 
59.66 


169 
526.95 
67.69 


1,955 
524.63 
63.53 


120 
507.31 
56.09 


Crada 5 






T - 






















* Pall 


N 
Mtan 

S.O. 


2,227 
465.59 
47.00 


112 
460.78 
58.19 


6Q2 
496.73 
4 60.27 


78 
474.29 

75.35 


567 
476.14 
52.34 


33 

485.77 
£9.11 


6,610 
535.90 
59.63 


657 
499.51 
64.25 


3,603 
546.67 
61.21 


346 
527.68 
69.14 


2,205 
526.24 
67.01 


193 
507.86 
64.36 


Spring 


N 

Mtan 

„ S.D. 


2,227 < 
490.79 
50.36 ' 


143 
476.78 
53.50 


602 
520.62 
* 65.09 


46 

499.60 
64.09 


587 
506.03 
57.52 


14 

472.36 
56.19 


6,610 
562.54 
63.93 


466 
536.14 
60.34 


3,603 
576.06 
64.93 


167 
554.03 
64.66 


2,205 
554.06 
70.36 


107 
539.64 
71.67 


Qrada 6 




























rail 


N 

Mtan 

» S.O. 


1,982 
489.88 

50.72 


85 

494. J6 
47.49 


905 
520.58 
64.84 


42 

510.14 
86.41 


620 
496.66 
54.01 


29 

488.66 
60. 9 A 


6,691 
567.96 
64.35 


744 

530.54 
70.20 


5,805 
574.65 
64.*04 


466 
549.20 
66.74 


2,515 
553.21 
70.57 


264 

535.56 
67.53 


tVpring 


, M 
Mtan. 
S.O. 


1,982 
515.89 
53.26 


95 
503.66 
53.30 


905 
547. 4 3 V 
67.69 


50 

517.34 
52.67 


620 
517.69 
56.33 


24 

512.92 
65.86 


6,691 
59 3. '89 
66/99 


380 
563.90 
71.13 


5,605 
596.61 « 
67.65 


270 
566.07 
67.64 


2,515 
576.39 
73.13* 


90 
566.07 
75.93 
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Table 1-7 

Math Achievement Scores for the First-Year Sample by 
Availability of the Fall and Spring Scores and Math CE Status' 



- Hath 

cvstetue 




Titfe If * 
in Title": 


tudente 
Schools 


Other-CE Students 
in Title Z Schools 


Ot Students in 
Other-CE Schools 


Non-CE Students 
in Title X Schools 


Non-CE Students in 
Othes-CE Schools 


Students in 
Non-CE Schools 


Availability 
of Scoree* 




>*11 and 

spring 


V 

rail or 
Spring 


rail and 
Spring 


rail or 

Spring 


rail and 

Spring 


rail or 
Spring 


rail and 

Spring 


rail or 

Spring 


rail and 
Spring 

a 


rail or 

Spring 


rail and 

Spring 


rail or 

Spring 


Grade 1 




^9 
























rail 


N 

Mean 

S.D. 


1,598 
309.42 
34.04 


165 
307.70 
X3.08 


855 
325.67 
34.57 


105 
318.62 
37.88 


329 
325.00 
35.55 


*49 
326.82 
30.7? 


8,440 
331.49 
34.37 


1,370 
321.97 
35.81 


3,484 
341.32 
34.22 


506 
329 48 
36.78 


2,132 
370.52 
37.01 


338 
322.66 
38.58 


Spring / 


N 

Ha an 

S.D. 


1,598 
370.99 
43.56 


466 
355.04 
43.69 


855 
382 • 87 
41.51 


100 
377.95 
44.72 


329 
387. 46 
50*95 


/ . 

IS 

408.87 
59.02 


8,440 
394 . 66 
1^44.71 


760 
380.03 
44.12 


3,484 
♦ 401.70 
43.77 


294 
384.03 
41.00 


2,132 
388.95 
45.08 


177 
384.83 
46.56 


Grade 2 












291 
380.95 
43*66 




— 












rail 


N 

'Mean 

S.D. 


1,686 
362.51 
40.26 


123 
349 . 35 
47.25 


808 
386.16 
45.52 


99 
375.43 
41.98 


35 

385.77 
/ 50.77 


7,499 
395.22 
43.97 


1,137 
378.74 
44.69 


V247 
406.79 
43,58 


410 
391.80 
40.99 


1,947 
390.57 
44.62 


255 
380.39 
42.73 


Spring 


(He an 
*D. 


1,686 
415.96 
48.02 


132 
403.69 
47.98 


808 
440.14 
49.70 


76 

427.47 

51.06 


291 
435. 31 
55.74 


12 

445. 17 

55.59 


7,499 
451.01 
49.74 


624 
431 • 70 
51. |9 


3,247 
464 .84 
49.49 


237 
445.20 
- 45.85 


1,947 
443.31 

52.23 


174 
437.45 
52.33 


.Grade 3 




























> 

rail 


N 

Mean 

S.D. 


1,79~3 
407.86 
43.90 


139 
404.36 
45.37 


768 
431.07 
50.82 


61 

419.11 
49.82 


369 
425. 9i 
50.94 


36 

428.25 
60.01 


7,301 
447.18 
47.30 


1,011 
427.20 
52.82 


3,189 
458.70 
48.52 


381 
440.70 
52.65 


1,942 
443.12 
49.14 


272 
434.19 
' 49.34 


. Spring 


N 
He an 

S.D. 


1,793 
463.22 
48.52 * 


120 
449.93 
52.64 


768 
480.87 
57.02 


69 

464. 17 

62.99 


369 
472.26 
63.06 


22 

497.00 
67.18 


7,301 
504 .42, 
54.44 


585 
483 .47 
58.29 


3,189 
519.77 
56.00 


232 
497.47 
54.06 


1,942 
500. 72 
59 73 


166 
490.13 
57.19 


Grade A 






f 






















Fall 


N 

Mean 

S.D. 


1,434 
445.02 
48.31 


92 

437.45 
47.88 


845 
473.31 
59.06 


61 

454.59 
67.75 


373 
466.96 
59.27 


23.; 
456.17 
71.01 


7,395 
499.99 
57.65 


999 
475.49 
60.78 


3,415 
511.69 
59.02 


377 
497.05 
58.53 


1,954 
495 .77 
59.10 


185 
475.74 
66.36 


Spring 


N 

Mean 
S.D. 


1,434 
498.40 
53.97 


98 

491.41 
56.34 


845 

66.58 


59 
53.96 


373 
67.46 


11 
30.63 


7,395 
550.40 
61.62 


562 
526.98 
62.88 


3,415 
563.01 
64.84 


,196 
548. 74 
71.09 


' 1,954 
546 .01 
67.19 


119 
525.84 
60.53 


Grade 5 




























Ja 


U 

Mean 
S.D. 


1,331 
486.82 
52.14 


66 

492.47 
55.74 


768 
520.48 
65.76 


69 

512.67 
67.45 


400 
496.63 
61,48 * 


26 

, 503.81 
72.27 


7,729 
543.91 
61.65 


915 
512.90 
65.50 


3,787 
555.99 
64.11 


346 
534.51 
65.59 


2,203 
540.03 
66.39 


197 
517.43 
67.93 


Spring 


» H 

'Mean 
S.D. 


1,331 
530.66 
56.87 


92 

524.62 
58.01 


768 
558.16 
71.61 


48 

553.90 
63.61 


400 
538.81 
67.37 


10 

481.80 
60.94 


586.79" 
69.94 


564.80 
64.27* 


603.41 
73.67 


169 
591 . 20 
72.06 


586.39 
75.65 


105 
569.84 
78.63 


Grade 6 




























Pall 


N 

Mean 
S.D. 


1,134 
526.61 
57.63 


.57 
514.40 

56.72 


858 
551 . 36 
70.59 


49 

532.92 
86.30 


457 
52 5. y± 
63. 3R t 


23 

519.70 
_ .63.11 


7,774 
585.00 
67.85 


757 
557.68 
68.81 


5,960 
596.04 
67.48 


464 

571.57 
72.22 


2,495 
583.88 
66.25 


298 
562.50 
68.00 


Spring 


N 

Mean 
S.D. 


1,134 
570.63 
61.40 


68 

S50.18 
69.72, 
,,-■„,./- 


858 
590.-55 
76.42 


48 
577.40 
58.09 


457 
68.36 


. * 19 
581.58 
84.79 


7,774 
^625. 35 
75.41 


419 
596.87 
72.85 


5,960 
635.24 
77.29 


277 
603.48 
74.43 


2,495 
623.05' 
79.38 


91 

613.09 
82.69 
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r Spring 1 heading indicates the group with fall scores spring scores where fall achievement is described, while it indicates 

ith spring scores but no fall scores where spring ach If « S p e nt is described. 
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In general, the missing-data group has slightly lower mean scores, but the two groups have com- 
parable standard deviations. The patterns of differences betweert the groups are similar for all CE 
categories and for all grades. This information bodes well forthe validity of comparisons among 
students in different CE programs to be presented in subsequent chapters. 

Additionally, the rates of missing CTBS scores in the entire first-year sample are presented in Table 
1-8 by CE status. For both reading and math scores, rates of complete CTBS data are slightly lower 
for the non-CE groups than they are for the CE groups. The same finding applied when th^e m issing 
data rates were examined for different samples (representative, comparison, and nomlr.ated) 
separately. Because there are very large numbers of non-CE students, the greater missing data rates 
for them still leave us with a sufficient number of cases for the purpose of comparisons among 
groups. 

Family Background. Although data are not presented, we also compared achievement differences 
between the groups with complete and incomplete CTBS scores within subsamples of students by 
race/ethnicity (white, black, Spanish heritage, and others), by participation in free or reduced-price 
meals (a proxy for family economic status), and by mother's educational attainment (college or 
more, high school graduate, and less than high school; an index related to family educational 
climate). For each subsample of students with similar background characteristics, a consistent 
pattern emerges: the groups having incomplete test data have lower mean achievement scores than 
the groups having complete data. 

Exceptions are found only when the number of dases in the former group is very small. These find- 
ings agree witjh -those reported in the Compensatory Reading Study (Trisman et al., 1975). Again, the 
standard deviations (s.d.) for the two groups remain similar and their differences in means are less 
than 3 population s.d., signifying extensive overlapping of the two distributions. 

It is also of interest to note that excluding cases with m issing data on student characteristics results in 
negligible changes of the sample means except when mother's education is involved. Because the 
teachers were permitted to make a response 'cannot estimate' in the SBC item about parents' 
education, and such responses were treated as missing data, there is a substantial proportion (about 
one-third, see Tables A2-5 and A2-6 in Appendix A2) of students for whom information on mother's 
educational level is lacking. Omissions of these cases from the sample result in an increase of about 
.1 population s.d. for the mean test scores. This shows that the students whose mother's education 
is not estimated by their^ teachers tend to have lower test scores both in fall and in spring. The 
finding, however, does not have direct implications on the validity of the comparisons performed 
for this report, because results obtained from analvses involving or not involving the variable of 
mother's education are similar (see Chapter 2). 

The rates of missing CTBS scores were tabulated by racial/ethnic groups, by participation in free or 
reduced-price meals, and by mother's educational attainment because these characteristics were 
often included in the analyses. These rates were obtained for the entire sample as well as for the 
subsamples, separately. The results are presented in Tables A2-1 through A2-6 in Appendix A2. 
Examination of these tables reveals: 

• For both reading and math scores, and in almost all samples, students of Spanish heritage 
have the highest rates of missing scores, while non-Hispanic whites tend to have the lowest 

' rafes. 

• Students from families of lower economic status (those participating in free or reduced-price 
meals) have greater rates of missing scores than others. 

• Students whose mothers' educational attainments are lower have higher rates of missing 
scores than others. 
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Table 1-8 

Percentage of Students With and Without CTBS Reading/Math Scores for 
Fall and Spring, by Reading/Math CE Status 


Reading by Reading CE Status * Math by Math CE status* 


Grade 

Of CTBS Scores TI/ 002/ OCE/ NCE/ NCE/ NCE/ 

TI TI OCE , TI - OCE NCE Total 


TI/ OCE/ OCE/ NCE/ NCE/ NCE/ 

TI TI OCE TI OCE NCE Total 


Fall & Spring 84.1 82.7 82.6 78.4 * 81.1 81.2 80.5 
.1 Fall Only 7.0 8.3 9.1 14.5 12.4 12.1 12.1 
Spring Only 8.6 9.0 * 7.9 6.9 6.4 6.6 7.2 
Neither Time 0.2 0.1 0.4 0.2 0.0 0.1 0.1 

N 3,313 1,19| 695 9,111 3,992 2,649 20,954 


82.4 80.4 83.7 79.5 81.1 80.5 80.4' 

8.5 9.9 12.5 12.9 11.8 12.8 12.1 

8.6 9.4 3.8 7.2 6.8 6.7 7.2 
0.5 0.4 0.0 0.4 0.2 0.1 0.3 

1,939 1,064 393 10,615 4,294 2,649 20,954 


Fall Spring 88.3 83.6 85.9 78.7 83.0 82.0 82.2 
- 2 rail uniy b.J 0.0 y.J 14. J 10.9 11.0 11.1 
Spring Only 6.3 7.8 4.6 6.9 6.0 7.0 6.6 
Neither Time 0.1 0.0 0.2 0.2 0.1 0.0 0.1 

N 3,438 1,134 820 7,661 3,423 2,384 18,860 


86.6 82.0 e6.1 80.6 83.1 81.7 82.1 
6.3 10.1 10.4 12.2 10.5 10.7 10.9 
6.8 7.7 3.6 6.7 6.1 , 7.3 6.7 
0.3 0.2 0.0 0.4 0.3 0.3 0.4 

1,947 985 336 9,301 3,905 2,384 18,860 


Fall £ Spring 88.9 83.7 86.6 80.5 83.4 81.2 83.1* 

Fall Ofllv CQ "7 Q "7 Q 1 *) A 1A1 i i £ 1A1 

3 *axx v/Mxy d.o /.y /.y 1^.4 1U.J 11. b 1U.J 
Spring Only 5.1 7.8 5.4 6.9 6.3 7.1 6.5 
Neither Time 0.1 0.7 0.1 0.2 0.0 0.1 0.1 

N 3,398 1,056 726 7,422 3,509 2,386 18,497 


87.2 85.4 86.4 81.8 83.7 81. 4' 83.1 
6.8 6.8 8.4 11.3 10 0 11.4 10.3 
5.8 7.7 5.2 6.6 6.1 7.0 6.5 
0.2 0.1 0.0 0.3 0.2 0.3 0.2 

2,056 899 427 8,921 3,808 2,386 18,497 


Fall £ Spring 90.1 86.7 92.0 81.4 84.9 86.5 84.7 
4 Fall Only 4.3 7.0 5.1 12.0 10.0 8.2 9.4 
Spring Only 5.4 5.9 3.0 6.4 5.1 5.3 5.7 
. . Neither Time 0.2 0.3 0.0 0.2 0.1 0.0 0.1 

N 2,654 996 673 7,927 3,735 2,261 18,246 


88.2 87.3 91.0 82.3 85.4 86.4 84.5 
5.7 6.3 5.6 11.1 9.4 8.2 9.5 
6.0 6.1 2.7 6.3 4.9 5.3 5.7 
0.1 0.3 1.7 0.3 0.3 0.1 0.3 

1,626 968 410 8,983 3,998 2,261 18,246 


Fall & Spring- 89.7 86.2 92.6 83.5 87.5 87.9 86.2 
5 Fall Only 4.5 8.4 5.2 10.5 8.4 7.7 8.6 
Spring Onl/ 5.8 5.2 2.2 5.7 4.1 4.3 5.0 
Neither Time 0.1 0.2 0.0 0.2 0.0 0.1 0.1 

N 2,484 930 634 8,152 4,116 2,508 18,824 


89.1 86.8 91.7 84.1 87.8 87.8 86.2 
4.4 7.8 6.0 10.0 8.0 7.9 8.6 
6.2 5.4 2.3 5.6 3.9 4.2 5.0 
0.3 0.0 0.0 0.3 0.3 0.1 0.2 

1,493 885 436 9,188 4,314 2,508 -18,824 


Fall & Spring 91.5 90.4 92.0 35.8 88.7 87.1 87.9 
6 Fall Only 3.9 4.2 4.3 9.3 7.1 9.8 7.7 
Spring Only 4.4 5.0 3.6 4.7 4.1 3.1 4.3 
Neither Time 0.1 0.4 0.1 0.2 0.0 0.0 0.1 

H 2,165 1,001 674 8,033 6,541 2,889 21,303 


89.9 89.7 91.6 86.6 88.7 86.4 87.7 
4.5 5.1 4.6 8". 4 6.9 10.3 7.7 
5.4 5.0 3.8 4.7 4.1 3.1 4.3 
0.2 0.1 0.0 0.4 0.2 0.2 0.3 

1,261 956 499 8,982 6,716 2,889 21,303 


T~ ' Q ~ .tie I students in Title I schools, OCE/TI ■ Other-CE students in Title I schools, OCE/OCE « Other-CE students in Other-CE schools, 
Vn i^>1on-CB students in Title I schools, NC2/OCE « Non-CE students in Other-CE schools, and NCE/NCE » Non-CE students in Non-CE schools* 

_~L - 5G 



All the above findings point to a summary fact: students most likely to be educationally disadvan- 
taged (poor, minority) are those more likely to be missing critical data for our analyses. However, it 
was also found earlier that CE students, most of whom are poor and minority, have smaller rates of 
missing test scores than do non-CE students. This apparent paradox in the data arises because: 

• The difference in rates of missing test scores between poor and non-poor, and between 
white and non -white students are small. 

• The correlations between CE status and disadvantaged statuses (i.e., being poor, minority) 
are not [perfect. 

• Students who transfer from or into a school during the year are frequently recorded as non- 
CE students even if they have received the services before or after transferring. These same 
students also miss some tests and therefore contribute to the increased rates of missing 
achievement scores for non-CE students. 

Missing Data by School's Demographic Characteristics 

As there is little evidence in our results showing differential CE effects according to geographic 
region or urbanism of the schools (see Chapter 2), we have not presented data concerning the rates 
of missing test scores by these demographic dimensions. However, the reader may refer to the 
special report on attrition (Zagorski et al., 1981) for some information in this regard. The joint rela- 
tionships of various factors (e.g., achievement status, CE status, race/ethnicity, etc.) with attrition 
were also explored there, but the findings do not lend themselves to easy or clear interpretations. 

Missing Data for Teacher-Level Measures 

Another kind of missing data, especially in the regression analyses to be reported in Chapters 6 
through 8, is the missing teacher-level data. These missing data arise as a result of non-responses of 
the teachers and/or lack of information to link the students to their teachers. This problem, and the 
substantial amount of missing data for mother's education can reduce the sample for analysis to 
about 55 to 60 percent of its original size where both teacher-level information and student 
characteristics are required. In these cases, the relationships between student-level variables tend to 
remain similar to those obtained in the analyses that employ a larger sample by including students 
without teacher-level data but with the required student-level data. Hence, the loss of information 
because of incomplete teacher-level data is not expected to pose a serious threat to the validity of 
the findings. 

Summary and Conclusions 

The differential rates of missing test scores for groups of students with different characteristics, while 
modest, can bias the descriptions of achievement levels for the sample because these characteristics 
and achievements are correlated. Furthermore, within subsamples of students, the missing scores 
were consistently associated with students who obtained slightly lower scores on other test occa- 
sions (and thus with lower achievement, considering the high correlations between test scores). This 
characteristic of missing data can also introduce positive biases to the estimates of achievement 
levels for the entire sample as well as for the subsamples. However, comparison of the statistics for 
the complete-data group in the representative sample (Tables 1-2 and 1-3) with those projected for 
the population (Table 1-12 of Report 9) based on all cases having scores at the test administration 
suggests that such biases are negligible. 

It is important to remark that the emphasis of this report is on comparisons between groups rather 
than on descriptions. In this context, the concern is how the missing data will affect the validity of 
the comparisons. If one expects students of higher achievement and from more advantaged homes 
to have greater growth rates, the loss of information because of missing data will also be expected to 
bias the estimates of achievement growth. However, because the characteristics of missing data are 
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not substantially different among the analysis groups and Jthe missing data rates are moderate, their 
effects on comparative analyses are not likely to be serious. More important, most of our analyses 
explicitly use student characteristics (including initial achievement) to adjust for background 
differences. Consequently, the effects of differential losses of information by student characteristics 
are mitigated and the results are not expected to be compromised. 

ANALYTIC APPROACHES 

This section presents a discussion of the strategy taken in the analyses for this report, and summarily 
addresses a few specific analysis issues pertaining to the entire report. The rationale for each par- 
ticular approach will, however, be given in the chapter where the results of that approach are 
reported. 

General Approach 

Over the years, as each report of the evaluation of compensatory programs was issued, it was 
criticized on the analytic techniques used. These criticisms, while sometimes blurring the 
significance of the findings, served to encourage analysts to develop additional methods that would 
address the problems. Many of the difficulties in a survey-evaluation study arise because randomiza- 
tion cannot be achieved. Consequently, there is no guarantee that a comparison group can be 
obtained to approximate closely the unknown true state of affairs in the absence of the additional, 
compensatory services. A useful strategy under this circumstance is to resort to multiple techniques 
for analysis. Each analytic method allows different assumptions and addresses different 
methodological issues. If the findings with different methods are similar, theanalyses are robust with 
respect to a variety of assumptions. By synthesizing the results of a set of mutually complementary 
analyses, we hope to reach some generalizable conclusions that are applicable to different condi- 
tions, and thereby increase our confidence in the evaluation. 

Following Tukey's (1962; 1969) advice concerning exploratory data analysis, we have first plowed 
through the data descript vely to examine potential threats to the validity of the planned analyses. 
Theth reats may arise fro n unreliabilities of measures, differential growth rates amonggroups being 
compared, selection biises, and differential attrition that could enhance selection biases, etc. 
Awareness of these potential problems can guide us to make proper conclusions by considering the 
possible effects of biases. Another advantage of a thorough understanding of the data gleaned from 
these descriptive analyses is that many insights into good explanations of the findings in the inferen- 
tial analyses are offered. We then employed multiple statistical analyses and estimation methods to 
determine a reasonable range of the effects of CE by sorting out the many confounding factors that 
operate concurrently to influence educational development. 

The major problem of evaluating CE effects is that we are necessarily dealing with comparisons 
among groups having large preexisting differences. The seriousness of this problem has been 
pointed out most emphatically in Lord's (1967) paper that concludes, ". . . there simply is no logical 
or statistical procedure that can be counted on to make proper allowances for uncontrolled pre- 
existing differences between groups." This statement has encouraged many methodologists to 
search for better techniques. Some progress has been made, but researchers have mostly concurred 
in Lord's opinion (e.g., Cochran and Rubin, 1973). 

The recurrent recommendation in the literature now is to use multiple analysis strategies, accom- 
panied with careful appraisal of the validity of the findings from the different analyses and the 
plausibility of rival explanations (e.g., Reichardt, 1979). This kind of tactic has been successfully 
practiced by Cook and his colleagues in their assessment of the effects of viewing 'Sesame Street' on 
children's cognitive development (Cook, Appleton, Conner, Shaffer, Tamkin, and Weber, 1975). In 
the present report, we have adopted many different comparison methods that have different 
likelihoods of showing an effect. The results are then : integrated, with consideration of the implica- 
tions of each of the findings and their interrelationships, to provide summary answers to the 
research questions. 
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Taking this strategy, while it has the advantage that the conclusions are likely to be more convinc- 
ing, results in a profusion of analyses that may leave the reader in a state of confusion. Awareness of 
this problem has led us to place many of the results of analyses in the appendices, so that we can 
stress the convergences and those analyses in which we have the greatest confidence. The more 
technically trained reader will, of course, want to examine the results in more detail in order to 
understand better the strengths and weaknesses of the methods. The appendices are intended to 
serve.the interest of this latter group of readers. 

Some Specific Analytic Issues 

Level of Analysis. The primary level of analysis for this report is the student. The importance of 
choosing^an appropriate level of analysis in educational research has been recently noted in a series 
of discussions (e.g., Burstein and Knapp, 1975; Clendening, 1978; Cronbach, 1976). A general 
caution is that the appropriate level of analysis depends on how the finding is to be applied. In this 
report, the main interest lies in assessing the effects of CE on the cognitive growth of the students 
individually. Some will argue that classroom instruction has a collective effect and therefore the 
instructional group is the proper level of analysis. Yet, some will even argue that the school is the 
level of interest because the CE program is principally implemented in the school context. Addi- 
tionally, there are problems such as the level at which the data are observed and if there are 
heterogeneous within-class and within-school effects. To address these issues, one would have to 
resort to techniques for multi-level data analysis (e.g., Burstein, Linn, and Capell, 1978). 

Because the immediate purpose of this report is to address the effectiveness of CE in improving 
achievement, and because important data (selection for CE, test scores, and amount of services 
received, specifically) have been obtained for individual students, we have performed the analyses 
at the student level. In multi-level analyses, dummy grouping variables are commonly used to repre- 
sent group-level effects. The shortcoming of such a practice is that the results do not afford clear and 
substantive interpretations (Burstein, 1980). Instead of dummy variables, we choose to include 
group-level variables that have substantive meanings in some analyses, so that the findings can be 
interpreted easily. Specifically, the analyses to be presented in the second part of this report employ 
both teacher-level and school-leveTfcata (those obtained by aggregation as well as those collected 
directly for the schools) in the student-level model. By doing so, the contextual and higher-level 
(teachers and schools) effects can be assessed explicitly. This kind of analysis can best be described 
as student-level analysis with mixed-level data. 

A concern of the student-level analysis is that the student is not the primary sampling unit. Instead, 
schools were selected randomly within the sampling strata and all students in the schools were 
included in the data collection. Because a probability sample of students was not obtained, the 
question arises whether weighted data analysis should replace the usual unweighted analysis. Our 
decision is to analyze the data in an unweighted manner, as exact representation of the groups is 
not essential for comparison among groups. What is essential is that students in each group to be 
compared adequately represent that group. The large sample sizes and the stratified sampling 
scheme used to include students in the study augur well for the adequacy of the data. However, it is 
recognized that standard errors of mean differences between subgroups that cut across the strata 
and clusters in the sampling design can be underestimated when they are computed as if the sample 
were random. The comparisons of means between students in different compensatory programs 
can thus be biased. Similar biases can also be expected in the regression and structural relation 
analyses. At the present, satisfactory solutions to these problems have not been devised (Kish and 
Frankel, 1974). 

The Problem of Non-Equtvalent Control Croups. In our analyses we have resisted the temptation to 
re-sample in an attempt to match comparison groups on an ad hoc basis. Simple matching methods 
are generally held to be inappropriate because of serious regression artifacts. Advanced rpultivariate 
matching techniques have been proposed that overcome some shortcomings inherent in univariate 
methods, but they are very time-consuming and costly to implement, and have uncertain benefits 
(Sherwood, Morris, and Sherwood, 1975; Rubin, 1976a, 1976b). Instead, we employ blocking and 
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covariates in efforts to control for preexisting differences, and in some cases the covariates are 
adjusted for unreliability. 

Analysis of Subtest Scores. Our analyses have been restricted to univariate analysis with respect to 
the outcome (dependent) variables. In particular, the achievement scores for reading and math are 
analyzed separately, because the selection for CE, the data on instructional services, and program 
characteristics have all been recorded in each of the skill areas separately. This practice underscores 
the primary interest to evaluate the effectiveness of CE in raising student achievement levels in the 
subject for which compensatory services are provided. In general, reading and math achievements 
may influence one another in light of the substantial correlations between them. Thus, there is an 
interest to study the interactions between the effects ot reading and math CE. Such interactions, if 
they exist, will support the policy to integrate CE programs for different subjects. However, the cur- 
rent one-year evaluation is not adequate for investigating the inter-subject influence, because the 
interactions would have delayed effects. The present report will therefore concentrate on separate 
analyses for reading and math. The relationships between the effects of different CE programs can 
best be studied over a longer time interval. 

In the past, th^re was some interest in examining CE effects on the subskill areas (vocabulary and 
comprehension for reading; concepts and computation for math) separately. This interest is pro- 
moted by a belief that CE can be effective in improving comprehension or computation but not 
vocabulary or concepts because learning of the latter subskills may" be greatly related to family 
background and out-of-school environment (see Technical Report 4). To address this issue, Coulson 
and his colleagues have analyzed scores in these subskill areas separately and have occasionally 
found some different results (Coulson, Ozenne, Vaa Gelder, Inuzuka, Bradford, and Doherty, 
1975). But the evidence for differential effectiveness was mostly tenuous and inconsistent, so that 
analyses of subskill scores were discontinued in the later years of the study (Coulson, Ozenne, 
Doherty, Duck, Hemenway, and Van Gelder, 1976). 

Considering the results of Coulson et al., and the lack of specific information about teacher's 
emphases on different subskills, we do not expect the analyses of subskill scores to be fruitful. 
Moreover, problems associated with the small number of items for some subtests could undermine 
the validity of the findings because of low reliabilities and inadequate interlevel articulations (see 
Technical Report 9). We therefore do not analyze subskill scores. In passing, it may also be noted 
that multivariate analyses of the component scores for each skill could have been performed, but 
the results would have been difficult to interpret in light of the high correlations between the subtest 
scores (see Report 9). 

The Problem of Specification Errors. Last, we must address the issue of specification error in the 
analyses. By this we mean that the analyses can be held in question because they do not include 
some variables that could have a direct or indirect effect. We have attempted to use every available 
variable that we anticipated would have affected the results. The alternative strategy of throwing all 
conceivable variables into every analysis, in addition to being very costly, could introduce unstable 
parameter estimations and uninterpretably complicated findings. Often, we consulted results of 
previous studies and of our preliminary analyses and decided to omit some variables from the 
analyses. 

In reality, no analysis can consider every variable that every person deems critical to an accurate 
understanding of the findings. We heartily concur with Cooley (1978) that, "some degree of 
specification error will always be with us, but we are more likely to have a cumulatively improved 
understanding of educational processes if we are guided by more and more adequately specified 
models . . . ." To this end, we believe we have obtained as many critical variables as we could in 
the immense data-collection efforts and have selected almost all the relevant variables for inclusion 
in each specific analysis. 

In connection with the issue of specification errors, we should note that we have not obtained a 
measure of the degree of curriculum overlap with the contents of the CTBS tests, and therefore have 
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not been able to.incorporate it into the analyses. Recent studies (The National Institute of Educa- 
tion, 1977; Cooley and Leinhardt, 1978) have suggested that this measure, as a component index of 
the opportunity factor, is quite useful in explaining the variance of the posttest achievement scores. 
To the extent this finding applies to the context of the present study, some analyses in this report 
could be expected to suffer from specification errors. However, we have incorporated another 
major component (time) pf the opportunity factor into the analyses. In addition, the unique practice 
of using 'recommended level' scores (see earlier discussion in this chapter) for analyses in this study 
may reduce some of the biases introduced by the omission of a 'curriculum overlap' measure. The 
posttest level that gives a better distribution of scores for the students in a given grade within each 
school probably covers the curriculum content more adequately than does the other test level. If 
there is little overlap between the test content and what is being taught during the test interval, one 
may expect the score distributions to exhibit floor (have never been learned) or even ceiling (have 
been learned in previous years) effects. 

Finally, we remark that the Sustaining Effects Study is intended to evaluate the effects of educational 
practices in a general way as measured by tests that do not unduly reflect any specific curriculum. In 
a broad perspective that emphasizes improvement of generalized performance, the effectiveness of 
the nation's CE programs can perhaps be better assessed without deliberate consideration of the 
curriculum issue. Nevertheless, we agree that in some other cases the curriculum issue is important. 
With regard to this issue, the Substudy of Successful Practices in High-Poverty Schools has obtained 
a measure of curriculum overlap with test content (for grades 2 and 5 in 55 schools during the 
1978-79 school year), and will examine the effects of curriculum content on achievement scores in a 
later report Technical Report 16). 



SUMMARY 

In this chapter, we present some background information to facilitate the reading of this report. We 
review briefly the history of evaluating compensatory-education programs, especially of the Title I 
program, that leads to the Sustaining Effects Study. The study is designed to overcome the 
difficulties in previous evaluations so as to provide a better picture of the current state of the pro- 
grams. It has a nationally representative sample of schools and follows the educational experiences 
and achievement progress of the same students for three years. As a result, the long-term effects of 
compensatory services and the relationships between achievement growth and the educational 
process can be examined thoroughly. iese evaluation efforts begin with this report that analyzes 
the data collected during the first year of the study (the 1976-77 school year). 

This report examines student achievement growth during the school period in order to. provide a 
baseline reference for assessing the growth between school years (over the summer period). The 
general approaches and a few specific issues concerning analysis strategies are discussed to inforhi 
the reader of what to expect in the report. In essence, we employ multiple approaches to analyze 
the data and then synthesize the findings from mutually complementary analyses (which are based 
on various assumptions) to obtain an overall evaluation of the programs. 

Because the problem of data attrition is a common concern in all of our analyses, we address it in 
this chapter to prepare the reader for a better understanding of the results presented in subsequent 
chapters. As achievement scores constitute the most critical data in this report, the analyses of data 
attrition focus on the rates of missing test scores and their relationship with student characteristics. 
In order to assess how differential rates of missing data among analysis groups may affect the validity 
of the analyses, we also compare the distribution of test scores among students who supply different 
amounts of data. 

For the first school year of the study, we find that, combining all six grades, 9.4 percent of the 
students have only pretest scores, while 8.4 percent have only posttest scores. About 82 percent of 
the students are present in both the pretest and posttest administrations. Among students of dif- 
ferent backgrounds, the analyses show: (1) by race/ethnicity, students of Spanish heritage tend to 
have the highest rate of missing test scores, while non-Hispanic whites tend to have the lowest rates; 
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and (2) with respect to economic status, students from low-income families generally have greater 
rates of missing scores than others. Furthermore, students who miss scores in one test administra- 
tion on the average achieve lower scores on the other test occasion than those who have test scores 
for both administrations; the mean difference is usually less than .3 standard deviation of the score 
distribution in the population. The within-group standard deviations are very similar between the 
two groups, suggesting an extensive overlap between the distributions of scores. 

It is tempting to conclude from these results that the loss of information because of non-random 
missing data biases or invalidates the analyses to be presented in the remaining chapters. However, 
it should be remembered that student backgrounds have been explicitly considered in '.he evalua- 
tion to control for preexisting differences among students. In this way, we expect thi moderate 
amount of missing data and the small association between d Aa attrition and student characteristics 
to have little influence on the validity of our findings. 
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PARTI 



THE EFFECTS OF COMPENSATORY EDUCATION 
AND INSTRUCTIONAL SERVICES 



S3 



INTRODUCTION TO PART I. 



The first part of this report contains four chapters, addressing the effects of compensatory services 
and the factors that influence such effects. In Chapter 2, we examine the achievement pattern of 
students who do and do not receive compensatory services, and compare the achievement growth 
of compensatory-education (CE) students with various expectations for them in the absence of com- 
pensatory services in order' to assess the Mects^of such services. In addition to achievement in 
reading, math, and practical skills, we also efcspnne the students' development of attitudes toward 
learning and school. It is concluded that compensatory services generally have positive impacts on 
basic-skill achievement, particularly in math, and therefore ire helpful in arresting the anticipated 
gap widening between the achievement of disadvantaged and non-disadvantaged students. 

In order to understand how the effects of CE are brought about, Chapter 3 investigates the role of 
one of the most important aspects of compensatory programs— instructional services— in the 
achievement process. We find that the relationship between the amount of total instruction 
(measured by number of hours) and achievement growth tends to be positive, but quite small. As CE 
students tend to receive more instruction than non-CE students by special teaching staff and in small 
groups, we further distinguish the instructional services into three kinds: regular instruction that is 
provided by classroom teachers in groups of seven students or more; special instruction that is pro- 
vided by special teachers, aides, and assistants, or by regular teachers in groups of six students or 
less; and independent work with study materials or tutors. The differential effects of these three 
kinds of instruction (regular, special, and tutor/independent) are examined to determine which kind 
has greater effects.. The analysis reveals little evidence for positive effects of special instruction, so 
we conclude that such instruction can not explain {he positive impacts of CE demonstrated in 
Chapter 2. 

Although the analysis uncovers only a tenuous relationship between achievement growth and total 
instructional time, we remain hopeful that when the amount and intensity of effort are sufficiently 
increased, the achievement gap suffered by CE students can be narrowed appreciably. In Chapter 4, 
we focus our investigation on the issue of a 'critical level of effort' that is required to result in a 
meaningful reduction of the gap. For this purpose, the achievement growth of CE students is rjelated 
to the level of instructional effort which is measured by the resource-cost to reflect both the time 
and labor-intensity of the services. For the most part, we are unable to determine such a critical 
level of effort, but the analysis provides extra information on the relationships between achievement 
and instructional effort. 

Finally, we turn our attention to two non-instructional factors that Ve considered likely to have 
influences on the effects of CE. Two questions are addressed in Chapter 5: (1) What is the best time 
to provide compensatory services? and (2) Are the effects of compensatory services related to stu- 
dent history of participation in the programs? The results of our analyses support the belief that com- 
pensatory services can be more effective when provided at the earlier grades. With regard to par- 
ticipation history, the analysis concludes that there is not a simple answer to the'question whether 
repeated participation can enhance or suppress the immediate effects * i compensatory services. 

To inform the reader of what to expect in these chapters, we present some highlights of the findings 
below: 

• There are positive, but small, effects of compensatory services on reading and math achieve- 
ment of the participants. In reading, the positive effects are primarily shown in the first three 
grades and in grade 6; whereas in math the effects are positive in all grades, b'Jt of different 
magnitudes. These positive effects are noticeable particularly for students who receive the 
services that are funded at least in part by Title I, while it is difficult to demonstrate similar 
effects for students who receive compensatory services that are exclusively funded by non- 
Title I sources. 
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With respect to practical achievement and attitudinal development, there is little evidence of 
substantial effects of compensatory programs, most likely explainable by the inadequacy of 
the instruments used to measure them. 



On the whole, amount of total instruction has a positive but very small relationship with 
achievement growth. When the effects of different kinds of instruction are examined, there is 
some evidence for positive effects of regular instruction and independent work; special 
instruction (which is mostly provided to CE students), however, generally fails to show 
positive effects on achievement. Because CE students tend to receive more special instruc- 
tion and less regular instruction (with a total usually more than that received by non-CE 
students), it is concluded that the positive effects of compensatory services, when shown, are 
not likely to be attributable to the special instruction received by the students. 

There is tenuous evidence that a positive relationship between achievement growth and 
instructional effort exists throughout the range of efforts commonly observed in the current 
programs of compensatory education. Based on the results of Chapter 4, it is concluded that 
there is still not enough evidence to support the concept of a 'critical level' of instructional 
effort required to effect a meaningful narrowing of the expected achievement gap between 
CE and regular students. 

On the basis of the cross-sectional analysis, it is found that, under current implementation, 
CE benefits its participants relatively more at the earlier grades, particularly in reading. The 
relatively greater effects at the early grades are not accompanied by relatively greater efforts. 
These results suggest that earlier remedy delivered in time is more efficient. 

c 

The nature of the effects of repeating participation in the program remains unclear. At some 
grades, it appears that students who have participated for two years gain more in the current 
year than the new participants. At others, the results appear to be opposite. The inconsistent 
findings across grades may arise in part because we do not consider the entire history of par- 
ticipation (data are not available);, such history tends to be more complicated in the upper 
grades. 
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CHAPTER 2. EDUCATIONAL DEVELOPMENT OF 
COMPENSATORY EDUCATION STUDENTS 
DURING THE SCHOOL YEAR 



The ac/ifevement patterns in reading, math, and practical skills, and the development of 
students attitude toward learning and school were examined for CE and non-CE students. 
Five evaluation designs were employed to assets the effects of CE by comparing the 
achievement of CE students with various expectations for them in the absence of CE ser- 
vices. The results indicate that CE has been generally effective in accelerating reading and 
math achievement growth of its participants, and is thus helpful in reducing the 
anticipated gap between CE students and their educationally non-deprived peers. 
However, the effects ofCE are not latge enough to bring the achievement levels of the 
educationally deprived children up to par with the non-deprived ones. The positive effects 
ofCE are more commonly observed in math, than in reading. In reading, CE was primarily 
effective in the first three grades; whereas in math, it was shown to be more or less effec- 
tive in all grades. These effects were noticeable particularly for students who received CE 
services that were funded at least in part by Title I. By comparison, *t was difficult to 
demonstrate positive effects of other CE services that were exclusively funded by non-Title 
I sources, probably because these services need not directly aim at improving basic skills. 

With respect to practical achievement andattitudinal development, there is little evidence 
to show substantial effects of CE. For the most, part, the results are inconsistent across 
grades. The lack of interesting findings in these two areas may be attributed partially to the 
limitation of the single-level Practical Achievement Scale, and to the questionable validity 
and reliability of the Student Affective Measures, respectively. 

One of the primary goals of Compensate y Education (CE) is to accelerate the educational develop- 
ment of disadvantaged students. In this chapter, the educational development of CE students is 
examined to determine the extent to which the goal was achieved. As remarked earlier, our deci- 
sion to perform this traditional fall-to-spring evaluation stems from the conviction that it is an essen- 
tial component of a complete long-term evaluation. 

Fall-to-Spring Period for Evaluation. On the basis of their analyses using data from states and districts, 
David and Pelavin (1978) recommend that evaluations cover the summer months. Accordingly, 
they advise school evaluators to choose either the fall-to-fall or spring-to-spring period if only two 
testings are intended. Although an evaluation that includes the summer months in the pretest- 
posttest interval might provide a better index for long-term effects, because it considers summer 
losses or gains, it also confuses the issue by introducing a time period of academic experience that is 
less intense, highly variable, and difficult to assess. 

Summer recess is a long-standing educational policy, initially releasing children for farm work but 
later justified as being necessary for noncognitive development. Children's summer environments 
vary widely in their provision of educational stimulation: from a climate that promotes forgetting 
and the need for readjustment to school in the fall, to one t,at offers opportunities to assimilate, 
apply, and consolidate what has been learned, or to learn new skijls. These variations depend on an 
array of socioeconomic factors and family values that are not easily influenced by educational 
policies. Therefore, we can understand the effects of education only by separately examining the 
course of development from fall to spring and from spring to the next fall. 

With evaluations performed over each of the time periods, one may find that CE has been effective 
during the school year in improving the achievement of participants, but the effects have not been 
carried over to \he next fall. In such a case, CE effects might be maintained between school years by 
summer CE programs, if there were evidence showing the effectiveness of such programs in sup- 
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pressing the loss. There have been some controversies over the issue of summer loss. Some recent 
studies (Thomas and Pelavin, 1976; Pelavin and David, 1977) appeared to support the view that 
there is an absolute loss in achievement for disadvantaged students over the summer. However, the 
data were of questionable quality and appeared r to be nationally representative. Because the 
quality of data collected in the SES is superior to any of the data previously employed for 
investigating this issue (see Chapter 1), a separate report (Technical Report 8) has been devoted to • 
the assessment of the pattern of students' changes in achievement over the summ* months and the 
evaluation of summer schools. Additionally, results of longitudinal studies addressing this same 
issue across more than one year will be presented in Technical Report 15. 

Meanwhile, we have completed the one-year fall-to-spring analyses in order to provide a preview of 
the first-year results and to offer a thorough evaluation of CE effects during the school year. Results 
obtained with various approaches will also supply valuable information for selection of appropriate 
models and techniques to be employed in the multi-year longitudinal study. 

Cr/tena for £va/uat/on. The goal ^ raise the achievement levels of disadvantaged stud&nts through 
compensatory services is deliberately rather vague. A standard has never been set nationally for 
judging whether the goal has been met. Because this is a national evaluation, it is necessary for us to 
define criteria for judging goal attainment at the national level. To what extent the goal is reached 
depends on our expectations. One can make the goal a very ambitious one, such that it probably 
will never be met. For example, there was an optimistic view early on that Title I could help raise the 
achievement of participants to the level of their non-disadvantaged peers, aadin such a way that it 
would be maintained at that level thereafter with regular educational services. Between 1965 and 
1976, evaluations have d&shed that view by showing that CE students stay about as far behind their 
peers at the end of instruction as at the beginning (McLaughlin, 1977). These results led many to 
reduce their expectations so that CE would be considered helpful if participants don't fall behind as 
fast as if there were no CE. 

The anticipated use of the results also influences one's strategy in evaluation. In summative evalua- 
tion (Sciiven, 1967), one seeks to make decisions on whether the process is to be further supported. 
Formative evaluation, on the other hand, aims at recommendations for improving the process. 
According to this distinction, formative evaluation is appropriate as the objective of this study. 
Knowledge of how well we have achieved along the continuum of goal attainment will assist policy 
makers in setting future goals realistically and in finding modifications of the efforts so as to make 
greater expectations reachable. For this purpose, the educational development of CE students will 
be described and compared with a variety of criteria. By summarizing the results of the different 
comparisons, we hope to gain a clear picture of the effectiveness of the nation's CE programs. 

The comparisons used to assess the effects of CE should reflect a range of reasonable expectations 
for the participants' progress. These expectations can be formed on the basis of our knowledge 
about the likely situation assuming no'CE services. If experiments with random assignment had 
been feasible, we could have obtained such information from the control group. Unfortunately 
nearly all evaluations of social programs depend on observational and survey data from intact, not 
randomly constructed groups. The problems that threaten the conclusions drawn from these kinds 
.of studies have been extensively discussed (e.g., Campbell and Stanley, 1966; Lord, 1967; Cochran, 
1969; Campbell and Erlebagher, 1970; Campbell, 1974; Campbell and Boruch, 1975). Advances in 
estimating program effects based on designs with non-equivalent control groups and in improving 
" inferences from such data have been offered by methodologists (e.g., Goldberger, 1972; Cochran 
and Rubin, 1973; Rubin. 1973a, 1973b; Kenny, 1975; Bryk and Weisberg, 1976; Cronbach, Rogosa, 
Floden, and Prince, 1976; Rindskopf and Wolins, 1976; Roskam, 1976; Bryk and Weisberg, 1977; 
linn and Slinde, 1977; Linn and Werts, 1977; Magidson, 1977; Overall and Woodward, 1977a, 
1977b; Rubin, 1977; Barnow, Cain, and Goldberger, 1978; Reichardt, 1979; Bryk, Strenio, and 
Weisberg, 1980)., 

Drawing ideas from the literature and carefully considering the un ique features of our data base, we 
elected to employ norm-referenced standards as well as criteria derived from comparison groups to 
gauge the effectiveness of CE. As Stake (1967) pointed out, there are two types of comparisons — 
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absolute and relative. Both types of comparisons may well be employed in a comprehensive evalua- 
tion. *ln reality, few absolute comparisons are fruitful except in the evaluation of instructional pro- 
grams specifically designed for mastery learning. No meaningful absolute standard yn be set in the 
present context unless in reference to past findings. This is not just because of the use of standard- 
ized achievement tests as the chief measurement tools, but also because the goal of CE is intrinsi- 
cally a relative** one. The idea of providing CE to help disadvantaged students originated from 
findings summarized in reports like Coleman's (Coleman, Campbell, Hobson, McPartland, Mood, 
•Weinfeld, and York, 1966; see also Mosteller and Moynihan, 1972), which suggested that if left 
unassisted, the achievement gap between disadvantaged and non-disadvantaged students tends to 
widen with the years. Com pensatory services are devised to close that gap by raising the achieve- 
ment levels of the disadvantaged. Consequently, the accomplishment of CE can be more 
appropriately judged relative to the anticipated state of affairs than against an absolute standard. 

In fact, the distinction between the two kinds of comparisons is not unambiguous. For instance, one 
may argue that the old Title I standard of one grade-equivalent (GE) month of progress for one 
month of instruction is an absolute one. However, it could be regarded as a relative one in terms of 
its reference to the GE scale. Since the calibration of a GE scale depends on a norm population, 
such a standard implies a relative comparison. By this line of reasoning, the analyses we performed 
focus on, relative comparisons. The norm-referenced criteria are set on the basis of the norms 
established with the first-year SES data collected in the representative schools (Hemenway et al., 
M978). 

Other criteria are derived using data from non-CE students, either by forming different comparison 
groups or by sta'Jstical modeling. The purposively selected comparison schools, which bave high 
poverty concentrations but do not receive CE funds, enlarged the data base so that comparison 
groups as similar as possible to the CE students could be assembled. Additionally, student 
background information and, pretest scores rtiake it possible to search for statistical models that 
-adequately estimate the posttest performance for subgroups of non-CE students. The estimated per- 
formances of a group of non-CE students who are similar to the CE students then serve as a basis for 
cQmparisortS. 

^ Outcome Measures. The primary outcome measures in the SES are achievement scores on the 
• Comprehensive Tests of Basic Skills (CTBS). Although the basic skills of reading and math are essen- 
* tial for modern life, and CE is ultimately aimed at improving the futures of its participants' lives, the 
use of standardized achievement tests alone could be inadequate for assessing skill development. 
These tests are considered by some to be biased against minorities and the poor. In addition, the 
test content may not be relevant to some skills required in real life. To alleviate the concern aboyt 
test biases, both the reading and math subtests of the CTBS were^arefully screened to remove 
possibly biased kerns. Regarding the content, a Practical Achievement Scale (PAS) was administered 
to students in grades 4 through 6 to supplement the reading and math data. The PAS measures func- 
tional literacy and math skills required in coping with daily life. In this chapter, data obtained with 
the PAS are also analyzed in order to assess the effects of CE on the development of practical skills. 

A third measure to be examined is the Student Affective Measure (SAM). Improving student 
attitudes toward learning and school has been an objective of Title I, partly because many educators 
believe that there is a rel; ionship between attitude and achievement. There have been inconsistent 
findings about this relationship; positive relations were found by Coles and Chalupsky (1976) and by 
Shavelson, Hubner, and Stanton (1976), but negative ones were obtained in the Compensatory 
Reading Study (Trismen et ik, 1975) and the present study (Hemenway et ai., 1978). Despite this 
controversy, the attitudinal aspect of educational development is not to be ignored, because the 
cultivation of a positive attitude 'can enrich the learning experience, and that in itself may be an 
important objective for CE. The results from the analyses of the Student Affective Measures (SAM) 
are presented in the last sectipn of this chapter. 
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READING AND MATH ACHIEVEMENT - ARE CE STUDENTS CATCHING UP WITH 
THEIR PEERS? 



Because assessment of impact in the basic skills is the principal charge of this study, we devote most 
of our effort to it. The aim is to determine whether CE students make greater progress than 
anticipated, such that at the end of the school year they are closer in achievement to their non- 
disadvantaged peers than they would be if CE had not been provided. For this purpose, the analyses 
will assess ihe achievement growth of CL students relative to a range of expectations, without con- 
sidering the underlying mechanisms that effect the growth. This missing link will be addressed by 
the analyses presented later in this report. 

Evaluation Designs. Five types of evaluation models are employed that are related to the models 
required by the Education Department for use by grantees in evaluating and reporting on their local 
Title I projects (Tallmadge and Wood, 1976). The large SES samples provide us a unique opportunity 
to apply a variety of methods that require different subsets of data to address the same question. 
Briefly, the norm-referenced analyses are variations of Model A (norm-referenced design). The 
analyses of variance (ANOVA) with different layouts and different measures of growth, and the 
analyses of covanance (ANCOVA) using different analysis groups and adjusted for unreliabilities of 
the covariate (pretest score) are designed to address the cases of Model B (control-group design). 
The comparison of gains conditional on pretest scores is a deviation of Model C (special regression 
design). Additionally, the comparisons with expected growth represent a blend of Models B and C 
where regression-based prediction models are employed to mimic the performance of a control 
group that is like the treatment group in pretest scores and other relevant characteristics. The rela- 
tionship between our five models and the commonly used Title I project models are illustrated in 
Figure 2-1. 
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Figure 2-1 

Relations of the Five Evaluation Designs of This Chapter to 
Evaluation and Reporting Models for Local Title I Projects 

The analysis of each design further encompasses a class of subanalyses. All the analyses are devised 
to complement one another so that pitfalls in one may be avoided in another. In the end, we hope 
that the integrated findings from these different approaches will approximate an accurate evalua- 
tion. 

The Metric of the CTB5 Scores. As new norms have been established empirically, based on data col- 
lected in both fall and spring, the expected posttest achievement derived from the norms can be 
directly expressed in terms of the standardized normal score (z-score) associated with a percentile 
„ rank. Additionally, the vertical scale score (VSS) created specifically for this study measures achieve- 
ment on a continuous scale across test levels and can be directly and meaningfully used for the 
determination of gains over time. For this reason, the analyses described in this section were per- 
formed either with z-scores or with VSSs. 
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Croups of Students to be Compared. As noted in Chapter 1, reading and math achievement are 
examined separately, each employing CE status for the respective subject. A number of student 
groups are defined, separately tor reading and math, in terms of their CE status and/or other 
^ characteristics. We use the groups that will provide the sharpest comparison consistent with each 
analysis design. Th,4 six groups commonly used in the SES are explained below: 

• Title I students in Title I schools: students selected for Title I and possibly also other-CE in 
schools that receive Title I funds either alone or in combination with other-CE funds. 

• Other-CE students in Title I schools: students selected for only other-CE in schools that 
receive Title 1 as well as other-CE funds. 

• Other-CE students in other-CE schools, students selected for CE in schools that receive only 
other-CE funds. / 

/ 

• Non-CE students in Title I schools, students not selected forany CE in schools that receive 
Title I funds either alone or in combination with other-CE funds. 

• Non-CE students in other-CE schools, students not selected for CE in schools that receive only 
other-CE funds. 

• Non-CE students in non-CE schools, all students in schools that do not receive any CE funds. 

In the definition of the six CE groups, selection for CE is considered separately for reading and math, 
but the characteristic of schools depends only on receipt of CE funds, disregarding whether they are 
spent in reading or math or both. When we want to differentiate CE schools on the basis of subject 
emphasis, the last three groups are recombined into two according to the existence ofCE programs 
tn the subject. This distinction is motivated by the desire to account for possible spillover CE effects 
within the school and differences in school's need for CE in the subject. Many of the analyses to be 
presented adopt this distinction. The two newly created groups of non-CE students in reading are: 

• (Reading) nor.-CE students in (reading) QE schools, students not selected for (reading) CE, but 
attending schools that offer (reading) CE in at least one grade. 

• (Reading) non-CE students in (reading) non-CE schools, students not selected for (reading) CE 
and attending schools that do not offer (reading) CE to any students in the school. 

Parallel groups of non-CE students in math are obtained for math analyses. It would be helpful for 
the reader to remember this subject-specific definition of schools when only CE and non-CE 
categories are used to distinguish the schools. 

When we want to make especially sharp comparisons between CE students and non-CE students 
who are as similar as possible to one another, a subset is picked from each of the preceding two 
groups of non-CE students. The two new comparison groups are nade similar to the groups of CE 
students with respect to their need for special services, because only those non-CE students who are 
judged to need CE are included. These two restricted subgroups (again, subject-specific) are: 

• Needy non-CE students in CE schools. non-CE students in CE schools who are judged by their 
teachers to have need for CE in the subject area. 

• Needy non-CE students in non-CE schools. non-CE students in non-CE schools who are 
judged by their teachers to have need for CE in the subject area. 

There are several reasons for choosing these two comparison groups of non-CE students based on 
their judged need for CE. First, teachers' judgments of need for CE frequently play an important role 
in selecting CE participants (see Report 5). Teachers acquire intimate knowledge of their students' 
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performances and are likely able to make judgments of each student's need for compensatory 
assistanceJhat complement and adjust information provided by achievement tests* It may also be 
recalled th^in earlier years of Title 1, eligibility was frequently tied to some kind of teacher judg- 
ment. For instance, the identification of eligible students in the 1968-69 national survey reiicu on 
teacher estimates of whether a child had the ability to complete high school. Second, teacher judg- 
ment of need for CE was found to be closely associated with pretest achievement status. Specifi- 
cally, a cutoff near the 35th percentile maximizes the agreement between judged need and the 
dichotomy of achievement status defined by the cutoff (see Report 13). Third, a large proportion of 
CE students was judged to be in need of CE by their teachers, and achieved at low percentiles. 

We therefore consider teacher's judgment of CE need as a proper and valuable indicator of educa- 
tional disadvantage. The descriptive analyses for this report reveal that the average pretest scores for 
these two comparison groups are quite similar to those for CE students, and Title I students in par- 
ticular (see Figures 2-4 and 2-5). The comparability of average pretest scores between the CE groups 
and the comparison groups reduces the potential biases in many of the models used to analyzedata 
from an observational study. 

In forming the analysis groups, we did not distinguish between study samples (representative, com- 
parison, and nominated). Thus, CE students from the nominated schools were combined with those 
from the representative schools in the assessment of the effects of CE. The advantage of mixing CE 
students from these two samples is that wider program variations would be involved than otherwise. 
However, because the nominated schools are selected purposively on the basis of promising 
innovations in the schools' programs, it has prompted some to think that this practice might 
introduce a positive bias to the estimates of the overall effects of CE. In order to clear such a suspi- 
cion, we separately examined the achievement growth of the CE students in the nominated schools 
and found little evidence to confirm the expectation that CE programs in these schools might be par- 
ticularly effective. 

The followrng sections present the results for each of the five evaluation designs listed in Figure 2-1, 
with emphases on norm-referenced analysis and analysis of variance employing comparison groups 
that are similar with respect to achievement status. The findings from different designs are mostly in 
agreement, showing that Title I programs have been helpful in raising the participants' achieve- 
ment. However, it is difficult to demonstrate the effectiveness of non-Title I CE programs probably 
because of their diverse aims which need not focus on improving basic skills. The results also 
indicate that program effects are more noticeable in math than in reading, modest effects of reading 
CE are generally found in the first three grades while similar effects of math CE are shown in all 
grades. 

Comparison with Norm-Referenced Criteria 

One of the major drawbacks of norm-referenced analyses is that the norms do not represent ade- 
quately the performance of the population of interest. First, the standardization sample frequently 
does not include a sufficient number of schools (the accuracy of norms depends on the number of 
schools rather than the number of students, Lord, 1959), and underrepresents minorities and disad- 
vantaged students. Second, the tests are often administered to the standardization sample^only at _ 
one time (fall or spring), with norms for other times obtained though interpolations and/or 
extrapolations. Occasionally, the tests are given in both fall and spring, but they may involve dif- 
ferent groups of students and as a result the estimated norms do not reflect the effects of test-taking 
experience and may be confounded by the sample differences. Third, the testing times for evalua- 
tion often do not correspond to those for which empirical norms are available. 

When the evaluation employs different test levels at the pretest and posttest, there is an added 
problem of inaccurate equating between test levels. Test publishers frequently based their inter- 
level articulations on data collected by administering different test levels or forms to different 
samples at only one testing time. Consequently, the articulations ignore the possible changes of 
inter-level relationships over time, and the equating errors may be enhanced because of non- 
equivalence between samples. 



ERIC 




To overcome these difficulties, new norms (called the SES norms henceforth) were created that 
include a large number of schools from every segment of the population. Two adjacent levels of 
tests were administered to the same students in fall and spring to furnish data for the creation of 
norms and the equation of test levels. The great advantage of having these norms is that the stan- 
dardization sample appropriately represents the population under study. These data also involve 
the exact time points for which the evaluation is performed. As a result, these norms in effect repre- 
sent the projected performance of the study's subpopulations composed of elementary students at 
different achievement levels and at different grades. The d;' f erence score between pretest and post- 
test for afixed percentile rank is commonly accepted in the education community as an approxima- 
tion to the expected growth for a subpopulation of students initially achieving at that rank. By this 
way of approximation, the effects of CE can be estimated by comparingthe observed growth for CE 
students with the difference between the pretest and posttest scores associated with a percentile 
rank that most typically represents their initial achievement levels. Because an almost longitudinal 
sample was used to derive the fall and spring norms, the fall-to-spring growth estimated from them 
more truthfully describes the expectations than would that from norms created with cross-sectional 
samples. 

When the pretest and posttest employ different test levels, growth scores cannot be meaningfully 
obtained from the raw scores. In order to facilitate the measure of achievement growth, a common 
scale across test levels was created with the aforementioned longitudinal' data base. The test scores 
expressed in this scale are called vertical scale scores (VSS). The test levels were first equated 
separately in fall and spring and the two resulting scales were coordinated with statistical techniques 
to produce a scale that incorporates the inter-level relationships manifested at both times. In this 
way, we expect to achieve a better scale than the publisher's (see Report 9 for detailed description 
of the procedures for obtaining the VSS). Analyses for the first-year fall and spring data within grade 
are most likely to benefit from the greater validity of the growth scale. 

Another advantage of the SES norms is that as percentile norms have been established empirically 
for two adjacent test levels at each administration for each grade,, the two sets of norms based on 
different test levels can be jointly employed to obtain more accurate estimates of the expected 
scores. 

Turning to the standards chosen to gauge the success of CE programs, two criteria of fall-to-spring 
growth are used: 

A. VSS gain required to maintain the group's fall percentile rank. This criterion, referred to as 
'percentile maintenance,' is based on the hypothesis of equi-percentile growth. It stipulates 
that without intervention, students maintain the same relative achievement status. Although 
studies on the validity of this assumption have either been Inconclusive (Kaskowitz and 
Norwood, 1977) or suggested that there are positive, although small, biases in the estimates 
of the effects (Tallmadge and Wood, 1 980), it is intuitively appealing, easy to understand, and 
has beerv popularly applied (e.g., Tallmadge and Wood, 1976; Coulson et al., 1975). The 
criterion can be implemented either on a group or individual basis. In the present context, 
implementation on the group basis is considered (application at the individual level is 
discussed iaAppendix Bl). To set the criterion for a group of students, the percentile rank 
corresponding to their mean fall VSS is first located using the fall norm, and then the VSS for 
the same percentile rank is obtained from the spring norm. The difference between the latter 
VSS and the mean fall VSS is the growth expected under 'normal' (no-program) conditions. 

Because CE students are included in establishing the national norms, there may bea concern 
about the contaminating CE effects in this criterion. However, such contamination is ex- 
pected to have little influence in the conclusion of our evaluation. Suppose compensatory 
services have resulted in considerably better achievement for CE students; they would move 
up to the higher ranks. At the same time a group of ncr.-CE students would move down to 
the lower ranks because of their relatively smaller gains. Consequently, the percentile- 
mamtenance criterion would remain a good approximation of what the CE students would 
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achieve had they received no compensatory services. (See Appendix B1 for further discus- 
sion of the appropriateness of this criterion.) 



Two refinements of this criterion, one 'blocks' the groups by tenths of the score distribution 
to take into account differential growth rates at different achievement levels, and the other 
implements th£ criterion on an individual basis, are discussed in Appendix Bl along with the 
results of their analyses. 

B. Three-quarters of the VSSgain required to maintain the 50th percentile rank. This criterion, 
referred to as 'deflated growth', is essentially a deflated growth for the typical student. The 
idea of deflated growth originates from previous findings that disdvantaged students tend to 
have slower growth rates. The choice of three-fourths as the deflation is also empirically 
based. As noted in the First Year of ESAA report (Coulson et al., 1975), the ^standardization 
data show an average of two-thirds of the population growth rate for students in the minority- 
concentrated schools. Dividing pretest grade-equivalent (GE) scores by the number of 
months in school, Thomas and Pelavin (1976) estimated from state evaluation data a growth 
rate of about seven GE months per calendar year for Title I students. Interpreting ten GE 
months as the yearly growth for a typical student, this estimate amounts to a growth rate of .7 
of the normal rate. Following a suggestion of Horst, Tallmadge, and Wood (1975) that an im- 
provement equal to one-third of the standard deviation for the population distribution be 
considered educationally significant, David and Pelavin (1977) employed a criterion of eight 
GE months per calendar year (.8 of normal growth) in their evaluation. Despite the flaws of 
basing the estimates of growth rate on a GE score metric, we regard the finding of slower- 
than-normal growth for the educationally deprived children as quite plausible and believe _ 
that it is of interest to examine a criterion that reflects such ajinding^ 

In light of these data, we chose three-quarters as an approximate deflation factor for setting the 
expected growth for CE students assuming no CE effects. This criterion is unlikely to be con- 
taminated by the presence of CE students in the standardization sample, because both their pretest % 
and potest percentile ranks tend to be well below the median, as shown in Table 5-1 of Chapter 5. 
Under this circumstance, any presumed increment in gain for CE students would likely affect the 
population mean rather than the median. 

Each criterion is intended as a benchmark against which. the growth of CE students can be judged. 
In order to offer practical meaning to the results of our analyses, achievement growth for 
appropriate groups of non-CE students (i.e., the two comparison groups judged as needing CE) was 
examined in the same fashion so that the results can serve as reference points for judging the effec- 
tiveness of CE. 

Traditionally, a significance test is carried out to decide if a criterion has been met. However, it is 
well known that when the sample is large a statistical significance can be obtained even if the actual 
difference is of no practical meaning. Hence, there is a recent emphasis on educational significance. 
The standard for educational significance as suggested by Horst et al. (loc. cit.) proves to be 
unsatisfactory, particularly because it is not of uniform stringency across grades (Kaskowitz and 
Norwood, 1977). We therefore elect not to use any kind of significance test, but rather a decision- 
based approach. We do this by presenting the observed data and the minimum values necessary to 
conclude that the criterion has b^en met with a certain confidence. 

In a strict sense, a decision-theoretic approach would require explicit assessments of the evaluator's* 
prior belief and personal utilities for different outcome status. We do not believe that a rigorous 
approach of this kind is practicable at present. A compromise is to base decisions on a reasonable 
rule that considers the current state of affairs only. As indicated in Chapter 1, there has been scant 
evidence of CE effectiveness. Furthermore, the delivery system is one of small increments of addi- 
tional services to students who generally have histories of educational disadvantage for many years 
and who face non-compensatory school and environmental factors each day except during the 
period of compensatory instruction. Acknowledging these facts, we think that any positive findings 
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are welcome Encouragement and we feel justified in using a lenient rule for judging success, so that 
small positive effects do not go unnoticed. 

The results of this approach are summarized in a way that the readers can make their own 
judgments on how l' l dy it is that each criterion is exceeded. We do this by presenting the observed 
gain and the minimum gain necessary, for each criterion, to conclude that the criterion was 
exceeded with a probability greater than .9. This probability level was assessed from the posterior, 
distribution for the mean gain, given the observed gain for the group under examination. Briefly, the 
posterior distribution is a 't' distribution with N-1 degrees of freedom (where N is the number of . 
cases in the group), and location and scale parameters equal to the sample mean and standard 
error, when a non-informative prior is used Ind a normal distribution with unknown variance is 
assumed for the observations (Box and Tiao, 1973). 

i 

We chose the probability level of .9 as a threshold for detecting the effectiveness of CE. That is, if 
based on the observed data, the posterior probability for the mean gain to exceed a criterion is 
greater than .9, it is reported that there is a positive effect; if this probability is less than .1, there is no 
evidence for a positive effect; and if this probability lies between .1 and .9 there is ambiguous 
evidence and is reported as such. This particular strategy for summarizing the results underscores 
our primary interest in noting all positive effects, even if they are small. To serve a broader interest, 
we also report the means and standard deviations of the t -distributions so that one can adjust the 
probability level according to one's own opinion to arrive at personal decisions. The analyses were 
performed for all CE students together, and then separately for the three subgroups categorized by 
CE funding sources. For reasons noted earlier, analyses were also done for CE students in the 
nominated sample and for each or the two groups of non-CE students judged to need CE. 

In addition, in order to examinedifferential effects according to various demographic characteristics 
of the schools, analyses were performed by geographic region, urbanism, minority and poverty con- 
centrations, and low-achiever concentrations. As expenditures are raw indicators of effort, the last 
set of analyses deals with subgroups formed by school's expenditure level for regular and compen- 
satory education. The findings of these latter analyses are tenuous and mostly inconsistent across 
grades, and therefore are not discussed in detail in the text. However, their results are presented in 
Appendix Bl (Tables B1-2 through B1-6). 

In reading the tables that summarize the findings, the probability interpretations are as follows: 

• If the lower limit exceeds the criterion, the probability for the mean gain to exceed the 
criterion is greater than .9 and thus a positive result is found according to our decision rule; 

• If the criterion exceeds the upper limit, this probability is less than .1, and thus no positive 
resultjs corcluded; 

• And if the criterion lies between the two limits, this probability is between .1 and .9, and thus 
the evidence is ambiguous and decisions may be suspended. 

We now discuss the results of the analyses. An example is provided to illustrate how to use the data 
in the tables to make decisions. 

Analyses (or All CE Students. The results for the analyses that include all CE students are presented in 
Table 2-1 and are summarized in Table 2-3 by expressing our conclusions in terr js of the categories 
of decisions Supported by the data. 

As an example, we find from the first row of Table 2-1 that, for grade 1, the average school-year gain 
in reading scores is 58.64 for CE students, with a standard error of .54. The lower limit of the 80 per- 
cent credibility interval is 57.96, indicating that the probability for the 'true mean gain' to exceed 
this value is .90. It follows that the probability for the mean gain to exceed 55 (the percentile- 
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maintenance criterion) is greater than .90 as 55 is smaller than 57.96. We thus conclude that there is 
a positive CE effect in reading at grade 1, and enter a ' f ' into the first entry of the first column in 
Table 2-3. 

On the other hand, the data in the fifth row of Table 20 show that, in reading for grade 5, the 
probability for CE students to have a mean larger than 26.10 (the upper limit of the 80 percent 
credibility interval) is only .10. This information indicatesa probability of less than .10thatthe mean 
gain for CE students exceeds the percentile-maintenance criterion, 27 (because 27 is greater than 
26.10). According to our decision rule, we conclude that there is no evidence for positive CE effects 
in reading at grade 5. In fact, the result implies a high probability (.9) that the average gain of CE 
students falls short of the percentile-maintenance criterion. This rsgative finding is noted in Table 
2-3 by a '-' in the fifth entry of the first column. 

i 

c 

The data in the third row of Table 2-1 illustrate yet another situation. For grade 3 in reading, the 
probabilities are .90 and .10 for the mean gain to exceed 33.64 and 34.91 (the limits of the 80 per- 
cent credibility interval), respectively. Thus, the probability that the percentile-maintenance 
criterion (34) is exceeded lies somewhere between .1 and .9, a result that provides ambiguous 
evidence for the effects of CE. We then indicate this ambiguity and our unwillingness to make a 
judgment one way or the other by a V in the third entry of the first column in Table 2-3. 
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Table 2-1 

Average Fall-to-Spring VSS Gain for CE Students and Criteria for Gain 

Fall-to Spring 80% Credibility „ mA _ m „ t ** 

* ,™ „ • * * ^ , Criteria for Gain 

VSS Gain Interval 

Grade 



Mean S.D. S.E. Lower Upper Percentile Deflated 

Limit Limit Maintenance Growth 



Reading 



1 


58^4 


35 


34 


.54 


57 


96 


59 


33 


55 


50 


2 


42 $9 


35 


58 


.52 


42 


23 


43 


56 


41 


35 


3 


34.28 


33 


45 


.50 


33 


64 


34 


91 


^ 


26 


4 


30.39 


37 


51 


.60 


29 


62 


31 


16 


31 


22 


5 


25.34 


35 


.41 


.59 


24 


59 


26 


10 


27 


20 


6 


25.34 


35 


73 


.60 


24 


57 


26 


12 


29 


20 



Math 



1 


50.33' 


36 


92 


.70 


59 


43 


61 


23 


53 


47 


2 


53.70 


39 


59 


.75 


52 


74 


54 


66 


51 


42 


3, 


52.76 


42 


57 


.79 


51 


76 


53 


77 


59 


43 


4 


48.05 


44 


17 


.86 


46 


95 


49 


15 


48 


46 


5 


41.68 


44 


86 


.90 


40 


54 


42 


83 


39 


29 


6 


40.86 


46 


54 


.94 


39 


66 


42 


07 


41 


39 



*Sample sizes (N) for each group can be obtained by adding up the N f s for 
the three CE groups in Table 2-2. * 

**Percentile Maintenance - VSS gain required to maintain a percentile rank 

associated with the mean fall VS: for the group 
Deflated Growth = Three-fourths of the VSS gain required < > maintain the 
50th percentile rank. 
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Inspection of Table 2-3 reveals that the percentile-maintenance criterion is satisfied at grades 1 and 
2 for reading and at grades 1, 2, and 5 for math, and the deflated-growth criterion is met in both 
reading and math at all grades. (In a later chapter, we will present data to show the actual 
magnitude of gains for CE students relative to the 'median' growth; see Tables E-1 and E-2 of Appen- 
dix E.) Overall, the results indicate greater CE effectiveness in the earlier two grades. 

Analyses for Subgroups of CE Students by Funding Categories, Table 2-2 provides the detailed results 
for these analyses. For ease of interpretation, a summary of the results is also given in Table 2-3 
following the strategy taken in the preceding analyses. The summary table shows that: 

• Again, the deflated-growth criterion is satisfied in nearly all cases. Exceptions are found in 
math for grades 4 and 6, where no positive CE effects for other-CE students can be concluded 
on the basis of this criterion. 

• Positive CE effects for other-CE students in Title I schools are mostly not evident as judged by 
the percentile-maintenance criterion. For other-CE students in other-CE schools, consistent 
positive results can be found only in reading for grade 2. Elsewhere, little evidence ot positive 
effect is observed for this group. 

• In contrast, positive results with the percentile-maintenance criterion are consistently 
obtained for Title I students in math with an exception at grade 3. Not surprisingly, similar 
results for Title I students and for all CE students are obtained, a consequence of the large o 
proportion oiCE students being servefl by Title t. Because there are sufficient sample sizes for 
all three subgroup^ the present findings suggest a more promising picture for Title 1 students 
than for others. . 

Analyses for CE Stydents in the Nominated Sample, Table 2-4 contains the results. Following the 
same decision strategy for drawing conclusions (see Table 2-6 for a summary), we find: 

• The deflated-growth criterion is satisfied i^ all occasions. 

• Positive effects in reading for grades 1 and 2, and in math for grades 1, 2, 4, and 5 are obtain- 
ed based on the percentile-maintenance criterion. 

To summarize, there are no indications from these analyses that CE is particularly effective in the 
nominated schools, and thus including CE students from these schools in the general analyses can- 
not be expected to distort the results of the national evaluation. 

Analyses for Reference Croups of Non-CE Students, Similar analyse' were also performed for the 
needy non-CE students in CE schools and for those in non-CE schools. The following observations 
which are summarized in Table 2-6 may be made from the detailed data presented in Table 2-5: 

• The results for thtf two groups are quite similar. One difference is noticeable in math for 
grade 4, where positive findings are obtained for the group in CE schools, but not for the 
group in non-CE schools. 

• In general, the deflated-growth criterion is satisfied, while positive findings are evident with 
the percentile-maintenancecriterion in reading only in grade 1 and in math for grades 4 and 
5. 

In short, fewer positive results are obtained for these groups of non-CE students, suggesting that 
some real CE effects are uncovered, particularly for the first and second grades in math and for the 
second grade in reading. 
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Table 2-2 

Average Fall-to-'ipring VSS Gain for the Three Groups 
of CE Students and Criteria for Gain 



G 
K 
A 
P 
E 



Fall-to-Spring 
VSS Gain 



80% Credibility 
Interval 



Criteria 
for Gain** 



CE Group* 



Sample 
Size 



Mean S.D. 



S.t. 



Lower. 
Unit 



Dppcr 
Limit 



Percentile Deflated 
Maintenance Growth 





• 
















Wading 










Title 


I 






2, 


785 


59.23 


35.06 


.66 v 


58.17 


60.08 


57 * 


50 


1 


Other 


in 


Title 


I 




987 


59.59 


34.72 


1.11 > 


58.18 


61.01 


63 


50* 




Other 


in 


Other 






574 


54.18 


37.44 


1.56 


52.18 


56.18 


64 


50 




Title 


I 






3 


036 


42 .68 


35.37 


.64 


41.85 


43.50 


43 


35 


2 


Other 


in 


Title 


I 




948 


41.31 


34.18 


1.11 


39.89 


42.73 


41 


35 




Other 


in 


Other 






704 „ 


45.96 


38.08 


1.44 


.44.12 


47.80 


40 


, 35 




Title 


1 






3 


022 


35.31 


32.52 


.59 


34.55 


36.06 


33 


26 


3 


Other 


in 


Title 


I 




884 


30.56 


34.50 


1.16 


29.08 


* 32.05 


40 


26 




Other 


in 


Other 






629 


34.55 


35.97 


1.43 


32.72 


36.39 


35 


26 




Title 


I 






2 


,392 


31.35 


37.92 


.73 


30.36- 


32.35 


32 


22 


4 


Other 


in 


Title 


I 




864 


28.46 


35.79 


1.22 


26.91 


30.02 


32 


22 




Other 


in 


Other 






619 


29.36 


38.21 


1.54 


27.40 


31.33 


35 


22 




Title 


I 






2 


,227 


25.19 


35.56 


.75 


24.23 


26.16 


31 


20 


c 


x Other 


in 


Title 


I 




802 


23.89 


32.91 


1.16 


22.41 


25.38 


27 


20 




Other 


i» 


Other 






587* 


27.88 


37.92 


1.57 


25.88 


29.89 


26 


20 




Title 


I 






1 


,982 


26.01 


37.32 


.84 


24.94 


27.08 


30 


20 


6 


Other 


in 


Title 


I 




905 


26.85 


32.75 


1.09 


25.46 


28.24 


28 


' 20 




Other 


in 


Other 






620 


21.01 


34.40 


1.38 


19.24 


22.78 


29 


20 



s 



Math 





Title 


I 






1 # 598 


61.57 


37.04 


.93 


60.38 


62.75 


52 


47 


1 


Other 


in 


Title 


I 


855 


57.20 


35.24 


1.21 


55.65 


. 58.74 


61 


47 




Other 


in 


Other 






329 


62.46 


40.07 


2.21 


59.63 


65.29 


61 . 


47 




Title 


I 






1 


686 


53.45 


40.61 


.99 


52.18 


54.72 


51 


42 


2 


Other 


in 


Title 


I 




808 


53.97 


36.99 


1.30 


52.31 


55.64 


57 


42 




Other 


in 


Other 






291 


54.36 


40.73 


2.39 


51.30 


57.42 


55 


° 42 




\ 

Title 


I 






1 


793 


55.36° 


40.40 


.95 


54.14 


56.58 


60 


43 


3 


Other 


in 


Title 


I 




768 


49.80 


45.28 


1.63 


47.71 


51.89 


58 


43 




Other 


in 


Other 






369 


46.32 


45.91 


2.39 


43.26 


49.38 


56 


43 




Title 


I 






1 


,434 


53.38 


42.57 


1.12 


51.94 


54.82 


48 


46 


4 


Other 


in 


Title 


I 




845 


45.26 


42.60 


1.47 


43.38 


47.14 


*5 


46 




Other 


in 


Other 






373 


33.88 


49.79 


2.58 


30.58 


37.18 


52 


46 




Title 


I 






1 


,331 


43.84 


44.67 


1.22 


42.28 


45.4T 


37 


29 


5 


Other 


in 


Title 


I 




768 


37.68 


44.07 


1.59 


35.64 


39. ^ 


43 


29 




Other 


in 


Other 






400 


42.18 


46.57 


2.33 


39.20 


45.16 


• 41 


29 f 




Title 


I 






1 


,134 


44.02 


47.84 c 


1.42 


42.21 


45.84 


42 


39 


6 


Other 


in 


Title 


I 




858 


39.18 


45.69 


1.56 


37.19 


41.18 


49 


39 




Other 


in 


Other 






457 


36.18 


44.30 


2.07 


33.52 


38.83 


43 


39 



* Title I « Title I students? Other in Title I « Othar-CE students in Title I schools i 
and other in Other - Other-CE .students in othef-CE schools. 

** Percentile Maintenance « VSS gain required to maintain a percentile rank associated 

with the mean fall VSS for the group. 
Deflated Growth « Three-fourths of the VSS gain required to maintain the 50th 
percentile rank. 
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Table 2*3 

Summary Results for the Extent That CE Students Have Attained an Average Achievement 
Growth Exceeding the Percentile-Maintenance and Deflated-Growth Criterion, 

by CE Categories* 



CE Group 



All CE Students 



Grade 



Title I Students 
in Title I Schools 



Other-CE Students 
in Title I Schools 



Other-CE Students 
in Other-CE Schools 




/ Percentile Deflated Percentile Deflated Percentile Deflated Percentile Deflated 
Maintenance Growth Maintenance Growth Maintenance Growth Maintenance Growth 



+ 
+ 



+ 
+ 
+ 
+ 
+ 
+ 



+ 
+ 



+ 
+ 

+ 
+ 
+ 



+ 
+ 
+ 
+ 
+ 
+ 



+ 
+ 
+ 
+ 
+ 
+ 



Math 

1 
2 
3 
4 
5 
6 



+ 
+ 



+ 
+ 
+ 
+ 
+ 
+ 



+ 
+ 

+ 
+ 
+ 



+ 
+ 

+ 
+ 
+ 



+ 
+ 
+ 



+ 
+ 
+ 



•+•# 1 and represent that probabilities of exceeding a criterion are greater than .9, 
between .1 and .9, and less than .1, respectively. 

The criteria employed for the achievement growth are : 

Percentile Maintenance: VSS gain required to maintain a percentile rank associated 
• with the .mean fail VSS c for the group. 

Deflated Growth: Three-fourths of the VSS gain required to maintain the 50th 




percentile, rarik. 
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Table 2^4 ^ 

Average Fall-to-Spring VSS Gain for CE Students 
in Nominated Schools and Criteria for Gain 



'• Grade 



Sample 
Size 



-Fall-to-Spring 
VSS Gain 



80% Credibility 
Interval 



Criteria 
for Gain* 







Mean 




S.E. 


Lower 
Limit 


Upper 
Limit 


Percentile 
Maintenance 


Deflated 
Growth 










Reading 


t 








1 


' 1,566^" 


63.36 


36.19 


.91 


62.19 


64'. 53 


56 


*50 


2 


1,553 


43.15 


35.50 


.90 


42.00 


44.31 # 


41 


35 


3 


1*,475 


35.45 


34.13 


.89 


34.31 


36.59 


. 36 


* 26 


4 


1,059 


20.22 


38.81 


1.19 


27.69 


30.74 


33 


- 22 


5 


968 


23.52 


34.75 


1.12 


22.10 


24.95 . 


29 


20 


6 


952 


25.85 


37.40. 


1.21 


24.30 


27.41 


29 


20 



Math 



1.030 
1,117 
1,116 
773 
751 
705 



37.45 


1.17 


* 64.28 


67.26 • 


5b 


47 


39.88 


1.19 


53.21 


56.26 


. 53 


42 


41.18 


1.23 


48.55 


51.70 


58, 


43 


44. 71^ 


1.61 


47.01 


51.13 


46* 


46 


C 45. 62* 


1.66 


39.51 . 


43.77 


39 


29 


46.92 


1.77 


40.19 


44.72 


42 


39 



^Percentile Maintenance: 



Deflated Growth: 



VSS gain required to maintain a percentile rank associated 
with the mean fall VSS for the group. J 
Three-fourths of the VSS gain required to maintain 'the 50th 
percentile rank. 
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Table 2-5 

Averse Fall-to-Spring VSS Gain for Non-CE Students Who Were Judged 
To Be in Need of CE and Criteria for Gain 



R Availability of Sample 
A *aading/Math CE size 
D in School 
E c 



Fall-tp-Spring 
VSS Gain 



Mean- 



S.D. S.E* 



80» Credibility 
Interval 



Lower 
Limit 



Upper 
Limit 



Criteria for Gain* 

Percentile Deflated. 
Maintenance Growth 







. r 








Reading 










Available 




541 


52. 


79 


36.70 


1.58 


/so 


.78 


54, 


81 


Available 


1 


,999 


54. 


83 


35.20. 


.79 


I 53 


.82 


55, 


84 


Available 




678 


38. 


41 


36.95 


1*42 


' 36 


.60 


40, 


23 


Available 


1 


,572 


39. 


79 

o 


35.28 


.89 / 


38 


.65 


40, 


93 


Available 




591 


29. 


48 


37*16 " 


1.53/ 

t 


27 


.53 


31 


44 


Available 


1 


,473 


34. 


10 


33.92 


.88 


32 


.97 


35 


22 


Available 




613 


30. 


25 


34.95 


l.,4l 


28 


♦ 44 


32 


.06 


Available 


1 


,729 


30. 


10 


•36.80 




28 


.97 


31 


.23 


Available 




548 


22. 


60 


36.48 


/1.56 


20 


.60 


24 


59 


Available-^ 


1 


,899 


24* 


74 


34. 85^ 


.80 


23 


.71 


25 


76 


Available 




676 


2 


14 


36.15 


1.39 


23 


.36 


26 


.92 


Available 


2 


,124 


23. 


89 


35/44 


.77 


22 


.90 


24 


.87 



Math 



49 

50 

44 
42 

33 
36 

32 
35 

27 
23 

28 
29 



•percentile Maintenance: VSS gain required! to maintain a percentile rank associated 

with the mean fall VSS for the group. 
Three-fourths of the VSS < gain required to maintain the 50th 
percentile rank. 



50 
50 

35 
35 

26 
26 

22 
22 

20 
20 

20 
20 



1 


Not 


Available 


1,051 


49.13 


35.91 


1.11 


47.72 


50.55 


55 


47 




V 


Available 


1,599 


54.13 


35.65 


.89 


52.99 


55.28 


54 


47 


2 


WOt 


Available 


1,035 


46.74 


40.26 


1.25 


45.14 


48.35 


53 


42 






Available 


1,353 


50.47 


38.89 


1.06 


49.11V 


51.82 


53 


42 


3- 


not 


Available 


1,057 


50.11 


42.66 


1.31 


43.43 


51.79 


59 * 


43 




\ 


Available 


1,370 


49.07 


39.29 


1.06 


47.71 


50.43 


58 


43 


4 


Not 


Available 


1,169 


46.97 


45.30 


JL.32 


45.28 


48.67 


46 


46 






Available 


• 1,455 


48.22 


42.51 


1.11 


46.79 


49". 65 


46 


46 


5 


Hot 


Available 


1,270 


35.75 


45.34 


,1*27 .* 


34.12 


37.38 


37 


29 






Available 


1,606 


38.86 


44.72 


1.12 


37.43 


40. 2? 


35 


29 


6 


Not 


Available 


1,321 


33.73 


47.66 


1 1.31 


32.05 


35.41 


43 


39 






Available 


1,767 


35.43 


44.79 


1.07 


' 34,07 


i36.80 


39 


39 



Deflated Growth: 



43 



so 
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Table 2-6 

Summary Results for the Extent That an Average Achievement Growth Exceeding the 
Percentile-Maintenance and Def lated-Growth Criteria Has Been Attained, for CE Students 
in the Nominated Sample and for Two Groups of Non-CE Students Judged as Needing Ct* 



Analysis Groups. 



/ <* 



CE Students 
in Nominated Schools 



Needy Non-CE Students 
in CE Schools 



Needy- Non-^" Students 
in Ndn-CE Schools 



Grade 



Percentile 
'Maintenance 



Deflated 
Growth 



Percentile 
Maintenance 



Deflated 
Growth 



Percentile 
Maintenance 



Deflated 
Growth 



Reading 


* 












1 


+ * . 




+ 


\ + 


+ 


+ 


2 


+ 


+ 




+ 


* - 


+ 


3 


• 


+ 




+ 




+ 


4 




+ 




+ 






5 




+ 




+ 




+ 


6 




+ 




+ 


_ * % 


+ 



Math 

1 
2 
3 
4 
5 
6 



+ 
+ 



+ 
+ 



I 



+ 
+, 

+ 
+ 
+ 



+ 
+ 
+ 
+ 



+ 
+ 
+ 



' + '/ ' and ■-' represent that probabilities of exceeding the criterion are greater than .9, 
between .1 and .9, and less than .1/ respectively. . 

Percentile Maintenance: VSS gain required to maintain a percentile rank associated ;*ith the 

mean fall VSS for the group. 
Deflated Growth: Three- fourths of the. VSS gain required to maintain the 50th percentile rank. 
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Another result worth noting is that the three : fourths detlation factor for growth yields a criterioathat 
i§ very easily satisfied. Clearly, CE stents learn more tharr that during the school year. Indeed,, we 
can observe from Tajble E-1 of Appendix E that, in reading, Title I students achieved average gains 
between 89 to 106 percent of the 'median' growth (VSS gain required to maintain the 50th percen- 
tile rank); while Needy Non-CE Students in Non-CE Schools gain between 79 to 103 percent of the 
median growth. Similarly, the data in Table E-2 show that, in math, the. corresponding percentages 
range from 86 to 1 14 perceni for Titled students, compared with a range between 66 and 93 percent 
for Needy Non-CE Students in Non;CE Schools. (In Tables E-1 and E-2, the average gains for each c 
the three subgroups of CE students and the two Subgroups of Needy Non-CE students are expressed 
in terms of percentages of the gains achieved by the median performers at the respective grades.) 

« « 

Analyses by Demographic Characteristics of Schools. As noted earlier, similar analyses were also 
applied to data from subsets of schools with different demographic characteristics so that differential 
C(E effects according to school characteristics couid be examined. On the whole, these analyses 
have not produced easily interpretable results. More important, there are few indications that 
spbsetting schools into more homogeneous groups would help sort out the complex phenomena of 
CE effects. We therefore relegate discussion of the results for these analyses to Appendix B1. 

Conclusions from Norm-Referenced Analyses. In conclusion, the norm-referenced analyses reveal: 

• The deflated growth factor of three-fourths appears to be an unnecessarily pessimistic expec- 
tation. The criterion of maintaining the fall percentile rank yields some meaningful results, 
and is likely a reasonable expectation. v 

• Positive £E effects are more frequent in grades 1 and 2. The impacts of CE on achievement 
growth are more noticeable in math than in reading. 

• More consistent positive CE effects are observed for Title I students than for other-CE 
students. This is an enc6uraging finding, particularly in view of the prevalence of Title I pro- 
grams and their concentrated efforts over the years. <, 

• Finally, the subset analyses by school's demographic characteristics p[Ove tp be not very 
fruitful, and their results are therefore presented in the Appendix., . . , % 

The implementation of the percentile-maintenance criterion on an individual basis generally con- 
firms the findings from the group analyses, with some method-caused exceptions. The results are 
reported in Appendix B1. , 

Differences in Achievement Growth Between ct and Nori-CE Students 

In this section we compare the achievement growth among CE students and various groups of non- 
CE students in order to assess the effects of CE. The analysis-of-variance technique is employed to 
examine the differences in achievement gains among groups. As a first sblutifcm, AHOVAs are per- 
formed for the six CE groups generally employed in the earlier SES reports (see palge 2-11), though 
these groups differ substantially in pretest scores. * . . * 

Because the expected faster growth rate for the groups of non-CE students can lead to unrealistically 
high comparison standards for the CE students, we perform a mdre penetrating set of ANOVAs in 
which the three groups of non-CE students are replaced with two ntir^CE comparison groups whose 
initial achievement and judged need of CE are similar to thoseVor the CE $tudenjs ; The two non-CE 
comparison groups are: students judged as needing CE and attending sohoolith at pro^&e CE in the 
subject (needy non-CE students in CE schools), and students who are judged $s needing CE but 
attending schools that do not provide CE in the subject (needy nqn-CJE students m non-CE schools). * 
Thus, five groups of students are involved in the seqond s# of-analyses: the three gjpups of CE 
students and two comparison groups of needy non-CE students. ' v 



To make the comparisons even sharper, by reducing further the preexisting differences in achieve- 
ment, we perform a third set of analyses that differentiate both CE and non-CE students with respect 
to their judged need for CE. In these analyses, CE status and teacher's judgment of need for CE (as 
made at the beginning of the study, i.e., during the October-November period of 1976) constitute 
the two factors for the two-way ANOVA design. These analyses also address the concern that CE 
services will help only the students with educational need and should not be provided to those who 
do not have such need. 

For the first two sets of the ANOVAs, two kinds of gain scores are analyzed: simple VSS gain and 
standardized gain scores. As pointed out by Kenny (1975), the standardized gain scores are appro- 
priate for the evaluation of. program effects \vhen the fan-spread hypothesis is assumed. (For an 
explanation of the fan-spread hypothesis, see the first section of Chapter 3.) 

Analysis of Variance for the Six CE Croups. To control for the substantial differences in initial achieve- 
ment among the g.oups, and thereby provide more sensitive comparisons, a blocking factor of 
preteot achievement status is introduced into this set of analyses. Two blocks are formed for each of 
the analysis groups, the 'bottom third' block consisting of students who scored at or below the 33rd 
percentile rank with both the at-level and below-level tests, and the 'top two-thirds' block compris- 
ing the rest of the students. The blocking is based on both the at-level and below-level test scores in 
order to reduce regression effects due to test unreliabilities. The choice of the 33rd percentile to 
form the achievement blocks is arbitrary, but made mainly because it is close to the average for the 
CE students. 

Table 2-7 summarizes the results of the two-way ANOVAs in terms of VSS gains for reading and 
math. We should first note that in grade 1 the sample sizes (see Tables B2-1 and B2-2) show that an 
unexpectedly small number of students is in the 'bottom third' biock, a phenomenon largely due to 
the low test reliabilities in the first grade. 

Looking at the means within each of the analysis groups, one observation stands out The average 
gain for the 'bottom third' subgroup is almost always greater than that for the 'top two-thirds' 
subgroup. This finding holds across the six CE groups, and in all grades for both reading and math. 
The gTeater gain for the lower-achieving subgroup clearly suggests a regression tbward-the-mean 
effect. As illustrated in Figures 2-2, for reading, and 2-3, for math, the growth rate is generally lower 
for the lower-achieving groups of non-CE students, in comparison with the overall growth rate for 
such students. (Average gain scores for these students can be found in Tables B2-6 and B2-7 of 
Aopendix B2.) Furthermore, data in Figures 1-1, for reading, and 1-2 for math, of Technical Report 9 
alsu show generally higher growth rates at the higher percentiles of the SES norms. 

In light of these observations, the larger mean VSS gains for the lower-achieving subgroups within 
each CE/non-CE category are likely indications of regression artifacts. Indeed, *vithin the groups of 
CE students, one can argue that those Who achieved in the top two-thirds at the pretest time could 
have done' so by chance, and they are therefore expected to make lower gains as a result of regres- 
sion to their own true scores. Conversely, within the groups of non-CE students in CE schools, the 
low pretest scores for those who scored at the bottom one-third are partially reflections oi" negative 
measurement errors, and consequently regression would explain some of their higher gains. By this 
line of reasoning, we are quite certain that the significant block effects in Table 2-7 are likely results 
of regression artifacts rather than of differential growth rates. 

Examining the interaction effects we find significances in grades 2 and 5 for reading, and in grades 3 
and 5 for math. Considering the extremely large samples, and he relatively small F-ratk^^Tfi^se 
interaction effects may be regarded mostly as a result of large sample sizes. Accordingly, the signifi- 
cant tests on the main effects of CF groups give similar results whether the interaction effects are 
adjusted for or not. The only exception to this is observed in reading at grade 4, where both of the 
two F-ratios are in the vicinity of the critical value, though adjustment of the interaction effects ren- 
ders the main effects of CE groups significant (at the .01 level). 
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Table 2-7 



Two-Way A NOVA of Fall-to-Spring Reading and Math VSS Gains by CE Status 
/ and Initial Achievement Status 



Initial 
Achievement • 
Status , 
(A) 



CE Statu* (B) 



Test Statistics 



Title X 
Students in 
Title I Schools 



Cther-CE 
Students in 
Title I Schools 



CE Students 
in Other-CE 
Schools 



Non-CE Students 
in Title X 
Schools 



Non-CE students 
in Other -CE 
Schools 



Students in 
Non-CE 
Schools 











Reading Cain Score Means 














Boston Third 
"">; Two Thirds 


60.7 

58 5 


59.8 
59 5 


56. 1 
S3. 5 


69. 3 , 
67. 3 


69. 1 
65.2- 


70.0 
64.9 


65 .6 
64.5 


A 

B | A ^ 

b!a.a»b 


2 54 
41.97** 




TOTAL 


59.2 


59 6 


54.2 


67.6 


65.6J 


66.0 


64.7 


12. 04** 


2 


Bottoet Third 
Top Two-Thirds 
TOTAL 


4S.2 
39 1 

42.7 


43.1 
40.3 

41.3 


51.0 
41.0 


43 2 
43.2 


51.4 
42.4 
43.4 


44.1 
41 .4 

42 .2 


45 2 
42.1 

43.0 


A 

b|a 

b|a,a*b 


29.24*> 
3.38" 

4.87" 




Bottoa Third 
To, Two- Thirds 
TOTAL 


I 7 . J 
31.5 

J5 3 


35. 3 
26.9 

30.6 


38.2 
30.5 

34.6 


36.0 
31.4 

32 3 


40. 3 
34.6 

35 . 3 


37.2 
31.7 

33 2 


37 . 1 
32.0 

33 6 


A 

b|a 

a*b! a.b 

b| A,A*B 


7.37" 
0 66 
4 65" 


4 


Botton Third 
Top Two-Third's 


34.6 
24 9 


29 8 
27.3 


32.2 
26.0 


35.4 
27.9 


36.6 
27 .4 


36. 1 
26 4 


34.6 
27. S 


A 

B| A 


149.69** 
2 59 




TOYAL ' 


31.4 


28.5 


29.4 


29.5 


28.8 


30 6 


29.7 


A"B[A.B 

b|a.a*b 


I 70 
3.04** 


5 


Bottoa Third 
Top Two«Thirds 
T^TAL 


26.1 
22.1 

25.2 


22.7 
25.1 
23 9 


29.4 
25.2 
27.9 


26.3 
26.7 

26.6 


32.2 
28.8 

29.4 


Jl.7 

25.9 

27.8 


27.6 
26.9 

27 I 


A 

BlA 

A*b! A.S 

b[ a.a*b 


1.95 
9 46* * 
4.24** 
10 77** 


c 


Bo t too Third 
Top Two-Thirds 


28 0 
20.5 


27.9 
25 7 


22.9 
17.3 


29.1 
25 3 


26.4 
23 4 


27.2 
24 2 


27.2 
. 24 1 


A 

D> A 


36.69" 
5.76** 




TOTAL 


?b 0 


26.9 


21.0 


25.9 


24.0 


25.2 


25 1 


A»si A.B 

b!a.a»b 


I *0 
5 43** 



Hath Gain Score Means 



1 


riot ton Third 


64.6 


63.1 


62.8 


64.8 


65. H 


60.1 


64 1 




25 83" 




Top Two-Thirds 


59 J 


55 2 


62.3 


62.8 


59.5 


57.9 


60 9 


b}a 


11.02" 




TOTAL 


61 6 


57 2 


b2.5 


62.2 


60.4 


58 4 


61 5 


A*B| A.B 

b| a.a*b 


l.>y 
5 85" 


2 


Bottom Third 


55 1 


58.5 


53.8 


60.0 


61 2 


54.0 


58 1 


A 


33 47** 




Top Two- Thirds 


51 2 


51.8 


54.7 


51 4 


56 2 


52.3 


54.2 


B|A 


7 10" 




TOTAL 


53.5 


54 0 


54.4 


55.8 


57. 1 


52 7 


55. ) 


A'bIa.b 
b!a.a-b 


1 13 

6 e*** 


3 


Bottoa Third 


59 3 


55 4 


42.9 


60.2 


63 0 


58 I 


59 2 


A 


16 0)" 




Top Two-Thirds 


49 9 


46 2 


48.8 


56 2 


60 6 


5? 4 


56 4 


b|a 


20 Ct" 




TOTAL 


55 4 


49.8 


46.3 


57.2 


61 1 


S7.6 


57 2 


A» Bj A.B 

b|a.a«b 


4 39** 

16 82" 


4 


Botton Third 


56 1 


45.5 


40.3 


55 8 


54 2 


54 3 


54 I 


A 


55.22" 




Top Two*Thirds 


48 7 


45 1 


28 8 


48 7 


SO 6 


48 7 


49 6 


b|a 


17 25" 




TOTAL 


53 i 


4S.3 


33 9 


50.4 


51 3 


50 2 


50 2 


a»b! a.b 
b!a.a«b 


1.76 
16 40" 


5 


Botton Third 


47.1 


40 6 


46.7 


42 7 


45 9 


51 0 


45 2 


A 


3 15 




Top ▼Wo-Thirdu 


37 A 


35 8 


36.1 


43.0 


47.8 


44.4 


43 8 


b|a 


10. 44" 




TOTAL 


43 H 


37 7 


42.2 


4?. 9 


47.4 


46.4 


44.2 


A"b1a,8 
B| A.A»8 


5.39" 
8 S3" 


6 


Bottoa Third 


48 7 


43.8 


39.6 


44 6 


42 9 


40.5 


43 9 


A 


. 53 f>3" 




Top Two-Thtrds 


37.7 


35.6 


31.5 


38 9 


38 2 


39.7 


38.4 


bIa 


2. 52 




TOTAL 


44.0 


39.2 


36.2 


40.4 


39.2 


39.2 


39 9 


a<b|a,b 

b]A.A»8 


1.69 
2 61 




Note. — Saapie sizes for each group and oeans reported to two deciaal places are provided in Table B*-i and 8^-2 in Appendix b2. 
•ftotationsj A*B - ir.teraction effect; b|a (b|a. A»B> • B effect conditional on A (A *nd A*B) effect (s). 
•*f*tost is significant at .01 level. 
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Months from Beginning of School Year) 

Figure 2-2 

Mean CI BS Reading Scores in Fall and Spring for Four Croups 
of Non-CE Reading Students by Grade 



9 

ERLC 



So 



\>t 48 



650-p 



60O-- 



550— 



500- - 



C 
A 
L 

E 450- - 

S 
C 
0 
R 
E 

400-- 



350- - 



300- 




> 



• Non-CE Students in CE Schools 

• Non-CE Students in Non-CE Schools 
Non-CE Students in Need of CE and 
Attending CE ^Schools 
Non-CE Students in Need of CE but 



Attending Non-CE Schools 



-I f- 



2.6 3.1 



<*.8 ^.1 



5.8 6.1 



6.8 



Grade-Testing Time (g.m., Where g 3 Grade Level and m = Number of 
Months 7 from Beginnirg ot School Year) 

Figure 2-3 

Mean CTBS Math Scores in Fall and Spring for Four Groups 
* of Non-CE Math Students by Grade 
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Inspection of the marginal means for the six analysis groups does not show consistent patterns 
across the grades. However, there are some indications that average gains for the non-CE students 
tend to be larger than for the CE students" We believe that the differential growth rates among 
groups of students with different initial ability account for most of such findings. Additionally, Title N 
students appear to make slightly higher gains than non-Title I students in the same schools. On the 
whole, the findings from these analyses are difficult to interpret because they suffer from severe con- 
founding effects of regression and differential growth rate. Based on these considerations, we do not 
recommend the practice of blocking in terms of pretest scores when gain scores are analyzed. 
These analyses are performed merely for the purpose of providing background information to aid in 
the understanding of different growth patterns among the groups. 

In terms of the fan-spread hypothesis, the problem of differential growth rates may be alleviated by 
examining standardized gain scores instead of simple VSS gams. Because we created empirical 
norms for both the pretest and posttest, the standardized gams scores can be derived by converting 
the percentile scores to standardized normal deviates (z-scores). The z-score gain then represents 
the standardized gam score based on the projected distribution of test scores in the population. 
Computing this kind of score is usually not feasible, because most evaluations have to rely on stan- 
dardized gain scores derived from the distribution of scores in the study sample. In order to 
investigate the influence of basing standardized gain scores on sample data, we also performed 
similar analyses employing standardized gain scores derived from the sample Gistribution of the 
entire first-year SES test data. * f 

In the analyses of standardized gain scores, blocking by pretest status is not necessary, as these gain 
scoresare calculated to mitigate against the confounding effects arising from different pretest levels. 
The results of the ANOVAs in terms of standardized gam scores based on the projected population 
norm (i.e., z-scores) are preser ted in Table 2 8. The data reveal some different results from those in 
the analysis of VSS gams. The greater gams for Title 1 students, in comparison with other groups, are 
more discernible on the basis of standardized gain scores than VSS gains. This finding is particularly 
pronounced for math, for *vnich Title I students make significantly larger gains in all grades but 
grade 2. For reading, average gams for Title I students are significantly .arger than other groups in 
grades 2, 3 and 6. The significant F-statistics in grades 1 and 5 reflect primarily the differences among 
the three groups of CE students. Practically identical results are obtained in the analyses using stan- 
dardized gam scores derived from the score distributions of the study sample. The sample-t. sed 
results are summarized in Table B2-3 of Appendix B2. 

Anah^isof Variance for CE and Need) Non-CE Croups. In this set o' analyses, two groups of non-CE 
students judged as. needing CE, instead of the original three non-CE groups, serve as the com- 
parisons. This new composition of the analysis sample makes direct comparisons among the groups 
in terms of VSS gams more appropriate for the evaluation of CE effects. This is so because the two 
comparison groups are similar to CE students with respect to educational statu* and thus can pro- 
vide more reasonable approximations to the expected gam for CE students, assuming there is no CE. 
Since blocking by initial achievement status is not important in th.s case, simple one-way ANOVAs 
for the five groups were performed. 

The pretest and posttest mean VSSs for the five groups are plotted in Figures 2-4, for reading, and 
2-5, for ma^h. Although the pretest means are not identical among tiie groups, we expect regression 
artifacts to play a negligible role in the findings. When the mean prete^ differences are small and 
sample sizes are large for the groups, the regressions of groui means ward the overall mean tend 
to be minute (see Lmdley, 1971; Lindley and Smith, 1972; ar.J Wang, Novick, Isaacs, and Ozenne, 
1977). The line segments in these figures are deliberately not connected between grades, so as to 
reduce the reader's temptation to interpret the data as longitudinal. Thed?ta are longitudinal within 
each grade, but not over the grades. 
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Table 2-8 

One-Way A NOVA of Fall-to-Spring Reading and Math Gains in Terms of 
Standardized Normal Deviate (z) Scores, by CE Status 



CE Status Cir.l 


Gr.2 


Gr.3 


Gr.4 


Gr.5 


Gr.6. 


Mean Reading Gains' 












Title ' I Students in Title I Schools ^ .01 


.03 


.07 




.03 


-.00 


.03 


Other-CE Students in Title I Schools -.05 


-.05 


.00 




.02 


-.03 


.02 


CE Students in Other-CE Schools -.16 


.08 


.04 




.00 


.03 


-.05 


Non-CE Students in Title I Schools .04 


-.04 


. UU 




.01 


— • Ul 


— • UJ. 


Non-CE Students in Other-CE Schools -.07 


-.05 


.02 




.01 


.02 


-.04 


Students in Non-CE Schools .05 


-.05 


.01 




.02 


.01 


-.01 


Total .00 


-.02 


.02 




.00 


.00 


-.02 


F Statistic 14.97* 


10.58* 


6.13* 


2 


.59 


3.87* 


11.07* 


f/ Mean Math 


Gains 












Title X Students in Title I Schools .12 


.04 


.13 




.08 


.09 


.09 


Other-CE Students "in Title I Schools -.06 


-.02 






.08 


-.04 


-.01 


CE Students in Othcr-CE Schools ' .07 


.02 


-.17 




.21 


.04 


-.02 


Non-CE Students in Title I Schools .04 


-.00 


.02 




.04 


-.01 


-.04 


Non-CE Students in Other-CE Schools -.06 


.00 


-,03 




.03 


.01 


-.07 


Students in Non-CE Schools -.06 


-.04 


-.01 




.03 


.05 


-.05 


Total -01 


-.00 


.01 




.03 


.01 


-.04 


F Statistic * m 19.50* 


2.32 


17.65* 


15 


.39* 


8.59* 


15.58* 



Note. — Sample sizes for each group can be found in Table B2-3 of Appendix B2 



♦Means differ significantly among the six CE groups at the .01 level. 
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Grade*Te sting Time (g.m., Where g « Grade Level and m = Number of 
Months from Beginning of School Year) 

Figure 2-4 

Mean CTBS Reading Scores in Fall and Spring for Three Groups of CE Students * 
in Reading and Two Groups of Non-CE Students in Need cf Reading CE 
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Figure 2-5 

Mean CTBS Math Scores in Fall and Spring for Three Groups of CE Students 
in Math and Two Groufes of Non-CE Students in Need of Math CE 



Table 2-9 provides the group means of VSS gain, ak «g with the F-tests for their differences among 
the groups. With the performance of the non-CE comparison groups as standards, positive CE 
effects are found for grades 1, 2, 3, and 6 in reading, and for all grades in math. The impacts ofCEon 
learning are particularfy noticeable for Title I students. * 

In addition, similar analyses of variance were also performed using standardized gain scores derived 
from the projected population distribution and the unweighted sample distribution. These analyses 
give very similar results as in the analyses with VSS gains. Their results are presented in Tables B2-4 
and B2-5 of Appendix B2 for the two kinds of standardized gain scores, respectively. As may be seen 
from Table 2-9 and these two tables, there are no appreciable differences among the findings in the 
three sets of analyses. 

Table 2-9 o 

One-Way ANOVA of Fall-to-Spring Reading and Math VSS Gain for the Three Groups 
of CE Students and Two Comparison Groups of Needy Non-CE Students 



CE Status Gr.l Gr.2 ^Gr.3 Gr.4 Gr.5 'Gr*6 



Mean Reading VSS Gains 



Title I Students in Title I Schools 


59. 2* 


42 


.68 


35.31 


31 


.35 


25 


.19 


26 


.01 


Other-CE Students in Title I Schools 


59.59 


41 


.31 


30.56 


28 


.46 


23 


.89 


26 


.85 


CE Students in Other-CE Schools 


54.18 


45 


.96 


34.55 


29 


.36 


27 


.88 


21 


.01 


Needy Non-CE Students in CE Schools 


54.83 


39 


.79 


34.10 


30 


.10 


24 


.74 


23 


.89 


Needy Non-CE Students in Non-CE Schools 


52.79 


38 


.41 


29.48 


30 


.25 


22 


.60 


25 


.14 


Total 


57.08 


41 


.75 


33.81 


30 


.30 


24 


.91 


24 


.83 


F Statistic 


8.77* 


5 


.69* 


6.02* 


1 


.12 


1 


.84 


3 


.43* 



Mean Math VSS Gains 



Title I Students in Title I Schools 


61 


.57 


53 


.45 


55.36 


53.38 


43 


.84 


44.02 


Other-CE Students in Title I Schools 


57 


.20 


53 


.97 


49.80 


45.26. 


37 


.68 


39.18 


CE Students in Other-CE Schools 


62 


.46 


54 


.36 


46.32 


33.88 


42 


.18 


36.18 


Needy Non-CE Students in CE Schools 


54 


.13 


50 


.47 


49.07 


48.22 


38 


.86 


35.43 


Needy Non-CE Students in Non-CE Schools 


49 


.13 


46 


.74 


50; 11 


46.97 


35 


.75 


33.73 


Total 


56 


.34 


51 


.46 


51.30 


47.86 


39 


.44 


37 v 43 


F Statistic 


22 


.54* 


6 


.16* 


7.00* 


16.13* 


6 


.08* 


9.10 



Note. — Sample sizes for each group can be found in Table B2-4 of Appendix B2. 
*Means differ significantly among the five groups at the .01 level. 

Analyses of Variance by CE Croups and ludged Need (or CE. In the last set of ANOVAs wc introduce 
a control variable, teacher's judgment of each student's need for CE, in order to compare gains 
between CE and Non-CE students who are similar with respect to their need for CE. The ir eraction 
effects between CE status and judged need for CE are examined to determine if there are dj/erential 
effects of Ctaccording to student's need for it. 

Table 2-10 presents the results of the two-way ANOVAs for reading and math. The effects of judged 
need are significant at grades 1, 2, and 5 for reading and in all grades for math. For both subjects, the 
non : neecly students tend to have greater growth; the finding being more consistent for math. The 
effect of CE status, when need is taken Into account, is significant in grades 1, 2, and 6 for reading 
and in all grades for math. From the means in Table 2-10, we can see that the Title 1 students who 
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Table 2-10 

Average Fall-to-Spring VSS Cains in Reading and Math by CE Status and Teacher's Judgment of Need for CE + 



CE Status 



Gra£e 1 



•Grade 2 



Grade 3 



Grade 4 



Grade 5 



Grade 6 



Needy « Not Needy Needy Not Needy Needy Not Needy Needy Not Needy Needy Not Needy Need/ Not Needy 



Titl6 T Students - v 
in Title I 'Schools 

Other-CE Students 
in Title I Schools 

CE* Students in 
Other-CE Schools 

Non-CE Students 
in CE Schools 

Nop.-CE Students 
in llon-CE Schools 



58.03 
51.42 

49.27 

54.83 

52.79 



63.93 
67.92 

62.49 

69.97 

70.44 



42.78 
40.43 

45.57 

39.79 

38.41 



42.41 
42.31 

47.79 

44.06 

44.53 



Reading VSS Gains 
36.01 32.37 
33.76 30.26 

34.80 34.24 

34.10 33.01 

29.48 35. 38 



31.36 
26.06 

30.54 

30.10 

30.25 



30.70 25.52 

32.40 25.72 

25.50 27.44 

28.98 24.74 

29.99 22.60 



24.33 
22.72 

29.31 

28.24 

29.57 



26.83 
27.73 

21.52 

23.89 

if .14 



24' 38 
25.34 

19.64 

2S.24 

25.28 



Effect*: 

NEED 636.82** 

CE|NEED 7.82** 

CE*NEEd|c£ ( FEED . 8.08** 

CE | NEED , CExNELD 5.87** - 



21.38** 
4.32** 
2.56 
2.89 



5.98 
2.21 
5.84** 
1.25 



3.50 
1.28 
2.93 
0.91 



41.37** 
1.88 
2.88 
1.77 



0.01 

4.05** 

1.41 

2.90 













Math VSS Gains 














Title I Students 
in Title I Schools 


59.70 


66.9"*, 


51.11 


59.19 


55.04 


56.89 


53.47 


53.80 


44.82 


40.28 


44.12 


44.88 


Other-CE Students 
in Title I Schools 


57.65 


56.61 


51.28 


56.20 •> 


43.94 


56.27 


45.37 


47.15 


35. :> 


41.44 


36.77 


42.37 


CE Students in 
Other-CE Schools 


56.89 


69.28 


47.20 


62.50 


40.14 


54.21 


45.04 


10.79 


42.06 


41.72 


36.11 


37.' 52 
39.52 


Non-CE Students 
in CE Schools 


54.13 


64.62 


50.47 


58.62 


49.07 


58.85 


48.22 


50.87 


39.86 


4.'. 05 


35.43 


Non-CE Students 
in Non-CE Schools 


49.13 


62.93 


46.74 


54.94 


50.11 


63.49 


46.97 


51.96 


35.75 


45.89 


33.73 


43.70 


Effect*: 


























NEED 


222.62** 


130.00** 


177.32** 




6.67** 


82.22** 


30.53** " 


ce|need 


, 14.58** 




8.27** 


15.40** 


18.59** 




4.34** 


10.99** 


CE* NEED | CE t NEED 




8.37** 




1.04 




4.88** 


16.97** 




5.71** 




3.39** 


CE | NEED / CE* NEED 


12.77** 




5.73** 




8.30** 


25.21** 




2.38 




4.08** 



Note. — Sample sizes for each group and marginal means are Provided in Tables B2-6 and D2-7 of Appendix B2. 

Teacher's judgment of need for CE was made in October-November, 1976. Students with missing data for CE status, teacher's judgment of * 
need for CE, or test scores were excluded from the analyses. 

NEED * unadjusted differences between students who were judged,, to be in heed of CE and those who were not so judged, Ce|neED * differences 
amcng students of different CE statuses afte* adjusting for differences with respect to judged need for CEj CE* NEED 1 CE , NEED « interaction 
effects between. CE status and judged need for CE; CE} NEED, CE* NEED ■ CE effects adjusted for both main effects of NEED and the interaction 
«ffee*« between CE and NEED. 
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were judged reedy frequently make larger gains than any other needy group. The interaction effects 
are more pronounced in math than in reading, but they are generally small, th'ough *.gnificant in 
many cases. ; % 

An unreported one-w^y ANOVA by CE status, employing a redqced sample that contains only 
students judged as needing CE, generally Confirms the findings based on the effects of CE condi 
tionai on judged need (see F-tests for CE/NEtD in Table 2-10). One exception was found for grade 3, 
where the one-way ANOVA showed a significant CE effect (F - 4.57). This result, however, is con- 
sistent with the information contained in the two-way ANOVA that indicated a significant interac- 
tion between CE status and Need for CE. The interaction effects indicate that for students who were 
judged i.eedy, CE students gain considerably more ihan non-CE students in Non-CE schools, while 
fcr students not judged as needy, there are little differences between CE and non-CE students. 

Summary and Conclusions for the Analyses of Variance. In summary, comparisons with the growth of 
non-tE students who are judged as needing CE systematically disclose positive CE effects in both 
reading and math. In reading, the effects are evident in the lower three grades and in grade 6. In 
ma*\ positive effects of different magnitudes are detectable in all grades. All significant effects a** 
especially noticeable for Title I students. These findings are generally consistent over diffeY^nt kinds 
of gain scores. However, when compared with the non CE studei.ts in general, the VSS gain fails to 
reveal clear patterns of CE effects, largely because of the prob'ems of regression artiracts and re- 
ferential growth rates. Analyses With standardized gain scores, on the other hand, show some 
significant impacts of CE, particularly in math, as compared with the relative gains of all non-CE 
students. (Jjr over3ll conclusion is that Title I students achieve better than if they do not receive CE, 
but the improvement is not sufficient to offset the educational disadvantage they start with. 

Analyses of v ovariance for Constrasting Gains Between CE and Non-CE Students 

The analysis of covariance (ANCOVA) is probably the most frequently used tool for the adjustment 
of pre-existing differences between groups in study designs that employ non-equivalent control 
groups However, it has many pitfalls and its validity is often undermined because of the measure- 
ment errors associated with the covariates (see, for example, Porter, 1 967; Cronback et al., 1 976), so 
ANCOVA should be used with great care. 

To supplement the results of the preceding ANOVAs, we also analyzed our data with the ANCOVA 
technique that incorporates Porter's method for adjusting the unreliability of covariates. Because 
our analyses indicated that the data mostly did not meet the basic assumptions for appropriate use 
of the ANCOVA model, and because the findings did. not contradict Or enlighten those of the 
previous^ section, we have elected tp report these analyses in Appendix B3. 

Con* prison of Gains Conditional on Pretest Scores * 

One of the major problems in the evaluation of social programs is that of selection bias (Goldberger, 
197?.). However, when selection for participation in. the program is strictly based on a cutoff score 
on a criterion measure (single variable or composite), the difficulty may be overcome, as an unbi- 
ased estimate of program effects is obtainable with regression methods (B^rnow et al., 1978; Rubin,, 
1977). In this connection, Campbell (1969) has advocated the idea df a regression-discontinuity 
design. Sween (197f) investigated the assumptions of a family of modpls for this design, and pro- 
posed some solutions to the models. In theory, the regression-discontinuity model affords simple 
solutions, if the stringent selection rule is followed. In practice, selection based strictly on a single 
cutoff is rarely found. Most evaluation studies have to deal with situations where there is a high cor- 
relation between program participation and .some criterion measure, but mapy data points violate 
the selection rule. Campbell refers to these as fuzzy cases of the regression-discontinuity design. 
There are not satisfactory solutions for this type of da^a, although many have been proposed 
(Campbell,. 1974\ . . 




• Nevertheless, in order to test the feasibility of implementing the regression-discontinuity model in 
the present study, we retrospectively collected achievement data from a number of scnools that 
employed a test score as the primary criterion for the selection of students to receive Title I services. 
They provided us with the achievement scores in the spring of a preceding year or in the fall of the 
1976-77 school year, whichever washed for the selection. In addition, they also stated the rules 
used for the selection so that we could verify them with their student participation data. Our 
preliminary analyses showed considerable discrepancies between the actual data and the selection 
rules. In fact, we could not find any set of data that was readily usable for the analysis with,a 
regression-discontinuity rno^el. ^ 

Because the schools invariably indicated that teacher recommendation was considered in the selec- 
tion process even if it was not used explicitly as a criterion, we decided to add thefdata 6f\ teacher 
judgment of student's need for CE to the investigation. We then tried to develops composite based 
on this data item and the test score in hope that the composite might efficiently separate CE/roVn 
non-CE students within a school. We found one set of data that could be useful. However' the 
numbers of students in the CE and'.non-CE groups were not sufficient to allow proper estimates of 
the regression coefficients required tn the model. The idea to implement this model was conse- 
quently abandoned. ( 1 

Instead, w,e considered the applicability of other special regression models to our data for the pur- 
pose of assessing the effects of CE. As noted in Appendix B3, the within-group regressions of posttest 
score on pretest score are generally non-parallel for CE and non-CE groups. Under this cir- 
cumstance, comparisons of predicted posttest score between groups can be useful when they are- 
conditional on pretest achievement levels (ElasHkff, 1969). This kind*of comparison Js also 
reasonable in the imperfect case of selection based on-^covariate, particularly when there are con- 

Vrderable crossover cases in a range of covariate values (Rubin, 1977). Indeed, previous results 
indicated a substantial overlap of the distributions of pretest, scores in the CE and non-CE sub- 

-samples. With these Considerations, we applied multiple-regression models that allow 
heterogeneous within-rgroup regression coefficients to-our data for further examination of the effects 
of CE. The error variances needed in "the t-test for the aforementioned conditional comparisons may 
be found in Zellner (1971). 

• **■ * 

8ecause the Title 1 guidelines imply that any student achieving at 3 level below the 50th percentile 
may be selected to receive services, we examined ihe CE status for students achieving in the 1st to 
5Qth percentile range. We found that between the 30th and 45th percentiles, both CE and non-CE 
groups are well represented. Vtence, it was decided to make the conditional comparisons at four 
pretext achievement levels that correspond to the 30th, 35th, 40th, and 45th percentile ranks. Table 
B4-1 presents the raw scores and VSSs for these four achievement levels, as determined on the basis 
of the at-level norms. , . 

Following the earlier distinctipns among groups of apn-CE students (those in CE and non-CE schools 
and those in need or no^nVieed of GE), we performed four sets of parallel analyses, each using<a dif- 
ferent comparison group of non-CE students. In each analysis, the predicted posttest scores given a 
pretest score were computed separately from the regressions estimated with data for 0$ students, 
and for non-CE students in the particular comparison gro.up. A t-test .was obtained for the dif- 
ferences Between the two predicted scores in order to evaluate the effects of CE. The four com- ^ 
parison groups involved in these analyses are listed in Table 2-11 and are described e^rl.ier-in this 
chapter. ^ 

s - 

Becatise measurement errors in the jeg,essor variable (pretest score in these analyses) frequently 
distort the underlying regressiap by introducing, non-linearity into the model (Cochran, 1970;' 
Lindley, 1974), we adopted botti the linear and quadratic regressions in the present comparisons. 
Empirical study and theoretical considerations suggest that {he departure from linearity due to falli- 
ble measure? of the independent variables can often be represented by a quadratic or cubic compo- 
nent. Because of the high correlations among the self-generated variables, components of higher 
order than the quadratic did not prove useful If suffices to comment that in any case, the linear 
component dominates the regression model. * * - 
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Table 2-11 

Predicted Reading and Math Posttest Scores for CE Students and Four 
Comparison Groups of Non-CE Students at the Pretest 'Cutoff' of the 
35th Percentile Rank, Based on Quadratic Within-Group Regressions 



C£ Students and Predicted Mean Predicted Mean 

Comparison Groups Reading Score* Math Score* 

Grade 1 jf 

CE Students 389 377 

Non-CE Students in CE Schools 401 385 

Non-CE Students in N^n-CE Schools 402 381 

Ne.edy Non-CE Students tn^CE Schopls 384** 366** 

Needy Non-CE Students in Non-CP Schools 384 362** 

^ 1 ' " 

. ' . ' Grade 2 

CE Students I 433 ^ 430 

Npn-CE Students in CE Schools. 445 442 

Non-CE Students in Non-CE Schools 439 ,437 

\ Needy Non-CE, Students in CE Schools 429** 424** 

♦N^edy Non-CE students in Non-CE Schools 425** 421** 



Grade 3 






CE Students 


465 


478 


Non-CE Students in CE Schools 


475 


491 


Non-CE Students in Non-CE Schools 


472 


491 


Needy Non-CE Students in CE Schools 


465 


471** 


Needy ttoa-CE Students in Non-CE Schools 


459** 


471** 



Grade 4 



CE Students . 488 512 

Non-CE Students in CE Schopls 502 525 

Nqn-CE Students ^in Uon-CE Schools 500 522 

Needy Non-CE ^tudents in CE Schools 489 510 

Needy Non-CE Students in Non-CE Schools 489 * 509 



' Grade 5 

CE Students ' . 525 556 

Non-CE Students in CE Schools ' 537 569 

Non-CE Students in Non-CE Schools ■ 535 565 

Needy Non-CE Students in CE Schools 525 551** 

Needy Non-CE Students in Non-CE Schools 1 ' 522 550** 



Grade- 6- 



CE Students 



Non-CE Studentjs in CE Schools 55§ 



548 580 
588 



Non-CE Stud ».nt 



s in Non-CE Schools 557 589 



** 



NeecLy Non-CE Students in CE Schools \„ 549 574 
Needy Non-CE Students in Norf-CE Schools 546 572** 



Note. — Sample sizes, linear predictions, and t-test values can be 
foun4 in Tables B4-2 and B4-3 of Appendix B4. . 
*The predicted posttest scores are obtained from the estimated within- 
group regressions of pdsttest on pretest. 
**Predicte 4 d scpre for the/CE students is significantly higher (at the f 
,01 level) tihan that for the respective comparison group. */ 
7 
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The results of these analyses are summarized .n Table 2-11 for the 35th-percentile cutoff, while 
detailed results for comparisons at the four cutoffs are presented in Appendix B4 (Table B4-2 for 
reading and B4-3 for malh). The most striking observation is the much lower predicted scores 
obtained with the regression based on data for CE students, than with regression based on data for 
non-CE students in general. This phenomenon is evident in all grades for both reading and math, 
and with either linear or quadratic models. Such negative findings should be interpreted cautiously. 
It is an indication that CE students are falling behind their non-CE peers in general, in the sense that 
the two groups have different growth rates. However, regression artifacts are expected to explain 
some of the differences. This is so because thp same observed pretest score, which serves as the 
comparison point, likely presents a higher true score for the non-CE students, whose group has a, 
higher mean achievement level. It is important to stress that this finding need not be considered 
- evidence for ineffective CE, ^ 

The picture changes when more appropriate comparison groups are involved. As evidenced by the 
significant and positive t-values, analyses using needy non-CE students as comparison groups con- 
sistently shov^ significantly positive effects of CE in grades 1 through 3 for reading, and in all grades 
but grade 4 fbr Jnath. The findings with the linear and quadratic models are similar. One noticeable 
exception to tftis overall statement is that in reading, there are no differences in grade 3 between CE 
sfudents and group oi needy non-CE students in CE schools. Thefindings of nonsignificant but 
positive effects of CE in grade 4 for math remain congruent with those in the previous ANOVAs, 
where significant differences in mean gains among the three groups of CE students and these two 
comparison groups were obtained. There it was found that Title I students on the average gained 
substantially more than needy non-CE students, but other-CE students did not show such benefits. 

In conclusion, when comparison groups with similar achievement levels as ,CE students are , 
employed, the present analysis approach presents a very clear picture of the effectiveness of CE, 
The results agree well with those in the previous analyses. In reading, CE tends tope effective in the 
lower three grades. In math, some effectiveness is shown in all grades. However, the benefits of CE 
are by no means great enough for it* participants to achieve equally well as the non-disadvantaged 
non-CE students. 

Comparison with Expected Growth Derived From Data for Non-CE Students 

In our final approach to assessing the comparative effectiveness of CE in terms of reading and math 
achievement, we developed statistical models to describe the achievement patterns for non-CE 
students based on their pretest achievement and background characteristics. The resulting models 
were applied to the data for CE students to obtain approximations to the expected performances for 
them in the absence of CE services. The actual performances of CE students were compared with 
these expectations in order to evaluate the effects of CE. This approach in effect employs a form of 
value-added analysis (Bryk and Weisberg, 1976). Because of the similarities of this approach to 
aspects of other approaches already discussed, and because the results did not alter our basic con- 
clusions on the effectiveness of CE, we present the method and report the findings in Appendix B5. 

Summary of the Effects of CE on Reading and Math Achievement Growth 

Integrating the findings obtained with different analysis approaches, we conclude: 

• In general, CE is more effective in math than in reading. The findings of the ESAA evaluation 
(Coulson et al., loc. c;t.) support the same conclusion. In reading, positive effects of CE are 
frequently observed in the lower three grades and in grade 6, but rarely or never in grades 4 
and 5. The less effectiveness ofCE in reading at grade 4 is similar to the finding of the Com- 
pensatory Reading Study (Trismen et al., loc. cit.). In math, positive effects of CE are evident 
in all grades, but the magnitude of effects varies with grade. In both reading and math, the 
significance of the effects of'CE are more or less dependent on the analysis methods (i.e., 
comparison standards). ' 
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• Among the CE programs, positive effects of CE are often detected only for those involving 
Title I funds (though they may occasionally also .involve other-CE funds). Evidence. for 
positive effects of non-Title I CE programs is not observed very frequently. 

• There is no marked evidence for negative effects of CE when the analyses employ 
appropriate comparison standards set on the basis of data for the non-CE comparison groups. 
However, it is clear that during the school year, CE students continue to achieve lower than 
their non-educationally-deprived peers. 

PRACTICAL ACHIEVEMENT 

In this section, we examine student practical-achievement growth in order to provide supplemental 
information on the educational development of students at grades 4 through 6, the grades in which 
the Practical Achievement Scale (PAS) was administered. As norms were not established for this test, 
the norm-referenced analyses were not performed. The rest of the four analytical approaches 
employed earlier in the analyses of basic skills were applied to evaluate the effects of CE on 
sludents' learning of practical skills. , 

Because the PAS has both reading and math items; and performance on it might be differentially 
affected by reading or math CE, in the ANOVAs and ANCOVAs, we examined the PAS gain scores 
for different groups of students defined in terms of their CE status in reading and in math, separately. 
The groups of students involved m these analyses were parallel to those employed in the reading 
and math analyses. Similar results were obtained with analysis groups formed either on the basis of 
CE status in reading or in math. We therefore combined the CE status in reading and math to define 
jointly the analysjs groups in the multiple-regression analyses and the analyses with statistical . 
models for the prediction of posttest performance. 

When analysis groups were defined in terms of CE status in both reading and math, students who 
received Title I services in reading and/or math were considered as Title I students, while the rest of 
the CE students in reading and/or math were considered as other-CE students, In the classification of 
schools, those that provided neither reading nor math CE to their students were designated as non- 
CE schools, and all others as CE schools. Among the CE schools, those having Title I in reading 
and/or math were regarded as Title I schools, while others were regarded as non-Title I CE schools. 
Finally, to form the non-CE comparison groups, i.on-CE students who were judged to be in need of 
CE for reading and/or math were considered as (educationally) needy non-CE students. 

Differences in Practical Achievement Growth Between CE and Non-CE Students 

Because the results of analyses based on simple gain scores were similar when appropriate com- 
parison groups were employed, we present only the results of analyses using standardized gain J 
scores. The standardized gain scores were derived from the data for the entire sample. We first 
examined the differences among the six CE groups in reading-and in math. Table 2-12 presents the 
mean standardized gain scores for the analysis groups and the results of the ANOVA tests. It shows 
that in grade 4, non-CE students on the average achieved gre'ater gains than did the CE students. In 
contrast, CE students in grade 6 gained more during the school year. Th^ differences among the 
groups were not significant in grade 5. These findings held regardless of whether CE status in reading 
or math was considered. o 

One possible explanation of the different findings among the grades is that non-CE students who are 
generally not educationally disadvantaged tend to learn the skills tested in the PAS earlier than the 
disadvantaged CE students. In order to examine possible differences in growth patterns between the 
groups of students with different educational needs, we plot, in Figure 2-6, the mean practical- 
achievement scores at the beginning and the end of the school year for groups of non-CE students in 
general and for specific subgroups of non-CE students who were judged as needing CE in reading 
and/or math. In comparison with the non-CE students in general, the slopes of the growth lines in * 
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Figure 2-6 indicate a slightly lower growtji rate for the needy non-CE students in grade 4, a similar 
growth rate in Gradtf 5, and then a greater growth rate in grade 6. 

/ 

Because the same PAS was administered to students in the three grades, the larger gain scores in 
grade 6 for the needy non-CE students who tended to score lower in the PAS could be a result of 
ceiling effects of the test. That is, in grade 6, many non-CE students would have acquired the skills 
tested in the PAS at the beginning of the year, and there are not many items left to reflect what they 
have learned du-ing the year. Consequently, their mean gain scores do not adequately represent 
their learning jn the period. In grade 4, we have a different situation: because most students con- 
tinue to learn tne skills in the test and the disadvantaged students tend to be slower in learning the 
same skills, the CE students show a lower gain score than c the non-CE students. 

In light of these observations, we think that the findingyfrom Table 2-1 2 may be largely explained by 
the different growth patterns between students of different educational needs and the ceiling effects 
of the test. If this is a plausible hypothesis, we would expect no differences in gain scores between 
CE students and the comparison group of needy non-CE students. We therefore performed a 3 one- 
way ANOVA for the three groups of CE students and the two groups of needy non-CE students (in 
CE and non-CE schools) to examine their differences in gain scores. Indeed, no significant dif- 
ferences were found among these groups in the three grades. The resirtfe of these analyses are 
shown in Table B2-8 of Appendix B2. It may be concluded, then, that there is no evidence for 
noticeable effects of CE on growth in practical achievement. ° 



Table 2-12 

One-Way ANOVA of Fall-to-Spring Standardized Gain Scores in Practical 
Achievement by Reading and Math CE Status 



Reading CE Math CE 

Grade 4 Grade 5 Grade 6 Grade 4 Grade 5 Grade 6 



Title I Students 


N 


2,367 


2,218 


1,979 


1,426 


1, 


321 


1,138 


in Title I Schools 


Mean 


-.02 


-.01 


• 05 


-.03 




-.01 


.03 


Other-CE Students 


N 


868 


798 


894 


844 




757 


839 


in Title I Schools 


Mean 


.03 


.04 


.06 


.00 




.01 


.05 


CE Students 'in 


N 


609 


576 


613 


366 




392 


450 


Other-CE Schools 


Mean 


-.07 


-.04 


.08 


-.11 




.02 


.12 


Non-CE Students in 


N 


6,448 


6,772 


6,, 863 


7,413 


7, 


710 


7,759 


Title I Schools 


Mean 


.03 


-.02 


-.00 


.02 


-.02 


.01 


Non-CE Students in 


N 


3,168 


3, 575 


5,758 


3,411 


3, 


759 


5,921 


Other-CE Schools 


Mean 


-.03 


.01 


-.03 


-.03 




.00 


-.03 


Students f in 


N 


1,887 


2,151 


2,455 


1,887 


2, 


151 


2,455 


Non-CE Schools 


Mean 


.05 


.01 


-.01 


.05 




.01 


-.01 


Total 


N 


15,347 


16,090 


18,562 


15,347 


16, 


090 


18,562 




Mean 


.01 


-•01 


-.00 


.01 




-.01 


-.00 


F Statistic 




6.37* 


2.12 


7.46* 


6.77* 




.81 


6.51 



* Mean standardized gain scores in practical achievement differ significantly among the 
six analysis groups at .01 level. 
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Figure 2-6 

Mean Practical Achievement Scores for Four Groups 
of Non-CE Students in Reading and Math by Grade 
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Analysis of Covariance for Contrasting Gains Between CE and Non-CE Students 



Four sets of ANCOVAs v parallel to those explained in the analyses for reading and math achieve- 
ment (see Appendix B3.) were performed for the PAS scores. Again, a 30 percent random sample 
was selected to supply data foe non-CE students when the six CE groups were analyzed. The 
reliability estimates used for the, correction of fallible pretest scores range from .6 to 1.0 in steps 
of .10. As there were few interesting findings, we report the results in Tables B3-9 to B3-16 of Appen- 
dix B3. 

Table B3-9 gives the mean practical-achievement scores in the fall and spring forall CE students and 
for two groups of needy non-CE students. It also shows that the assumption of homogeneous withm- 
group regressions is not violated in any of the three grades when reading CE status is the basis for 
forming the analysis groups. However, the assumption is satisfied only in grade 6 when math CE 
status is considered. The adjusted group means and the F-tests for their differences are presented in 
Table B3-10, which indicates practically no significant differences among the groups in all three 
grades, as the estimated reliability for PAS is likely to be less than .9 (see Table 2-3 of Report 9). 

The results of the other three sets of ANCOVAs are summarized, in Tables B3-11 through B3-16. 
There are few consistent and significant findings, particularly within the reasonable range of 
reliability estimates (.7 to .9). The findings generally agree with those discussed in the preceding 
section. 

Comparison of Gains Conditional on Pretest Scores 

As in the similar analyses for reading and math achievement, four sets of parallel analyses, each 
using a different comparison group, were performed. The reader may refer to the earlier section that 
describes these analyses for details of the rationale and procedures. Complete results for these 
analyses are reported in Table B4-4 of Appendix B4, whereas the last column of Table B4-1 in the 
same Appendix gives the pretest scores corresponding to the four achievement levels at which the 
comparisons of expected posttest scores are made. Because the preceding analyses did not reveal 
substantial differences in PAS gains between Title I students and Other-CE students and because 
Title I students account for a large proportion (about two-thirds) of the CE students,^ separate 
analyses for Title I students are not performed. 

For illustrative purposes, the results are also summarized in Table 2-13 for the cutoff at the 35th 
percentile. As in the analyses for reading and math, the most pronounced finding in this table is that 
CE students consistently fall behind at the posttest time when compared with the expected perfor- 
mance of non-CE students in general. Again, regression artifacts and the substantial pre-existing dif- 
ferences between the groups account for most of these differences in the expected pobuest scores. 

On the other hand, when subgroups of educationally needy non-CE students serve as the com- 
parison groups, only a few significant differences were obtained: at the 30th and 35th percentile 
'cutoffs/ the expected posttest score for CE students is significantly lower thaTi that for the needy 
non-CE students in CE schools in grades 4 and 6. However, the differences were very small and the 
t-ratios are only slightly larger than the critical value for significance at the .01 level. Considering the 
large samples and the lack of significance, at other comparison points (pretest levels), these results in 
effect support the previous findings that showed no appreciable effects of CE on the practical 
achievement growth of CE students. 

Comparison With Expected Growth Derived From Data for Non-CE Students 

Similar to the analyses for reading and math, two regression models were developed based on the 
data for non-CE students in order to estimate the expected posttest performance for CE students in 
the absence of CE intervention. The actual mean performance of the CE students was compared 
with the expectations derived from the prediction models to determine the effects of CE on the 



Table 2-13 

Predicted Practical-Achievement Posttest Scores for CE Students and Four 
Comparison Croups of Non-CE Students at the Pretest 'Cutoff' of the 35th 
Percentile Rank, Based on Quadratic Within-Group Regressions 



r*T? anH fnm t~ i con fiyoiinc Predicted 


» 

Mean PAS Posttest Score* 


t Grade 4 




CE Students 

Non-CE Students in CE Schools 
Non-CE Students in Non-CE Schools 
Needy Non-CE Students in CE Schools 
Needy Non-CE Students in Non-CE Schools 


13.6 
15-8 
15-4 
14-0 
13-5 


Grade 5 




jOS Students 

Non-CE Students in CE Schools 
Non-CE Students in Non-CE Schools 
Needy Non-CE Students in CE Schools 
Needy Non— C35 Stujdent^; in Non-CE Schools 


17,7 
^19.4 
~18.9 

17-9 

J. / .D 


Grade 6 


X 

u 


CE Students 

Non-CE Students in CE Schools 

Non-CE Students in Non-CE Schools 

Needy l^fon-CE Students in CE Schools A 

Needy Non-CE Studentrs in Non-CE Schools 


20,2 
' 21-5 
21-2 
20,7 
20,5 

i 



Note. — Sample sizes, comparisons at other pretest 'cutoffs 1 , t-values, 
and means for both linear and quadratic regression models can 
be found in Table B4-4 of Appendix B4. 
*The predicted posttest scores are obtained from the estimated 
within-group regressions of posttest. on pretest^ 



practical-achievement growth of its participants. The analysis procedures follow those in the 
reading and math analyses, as explained in Appendix B5. 

The potential predictors ard their selection into the regression models are indicated in Table B5-1 of 
Appendix B5. In the definition of the predictor variables, a student who was judged to be in need of 
CE in reading and/or math was considered as having need for CE. Similarly, a student who received 
CEin reading and/or math in 1975-76 was considered as having previous exposure to CE. The results 
of the cross-validations of the prediction models are summarized in Tables B5-2 and B5-3 of Appen- 
dix B5. The data indicate that the prediction models are adequate, and not particularly biased 
against specific groups of students. 

Table B5-6 in Appendix B5 presents the results of these analyses. Inspection of the data in this table 
reveals little evidence for positive CE effects on practical-achievement growth. Only in grade 6 and 
when the achievement pattern for non-CE students in non-CE schools is used to approximate the 
performance of CE students in the absence of CE, we find that observed mean for CE students 
exceeds the expectation. 
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Summary of the Effects of CE on Practical-Achievement Growth 

Putting together all th e results of the analyses for the PAS scored we conclude that positive effects of 
CE on the'growth of practical achievement are not generally detectable. The limitation of a single* 
level practical achievement test may be partially responsible for this lack of finding. 

ATTITUDINAL DEVELOPMENT - STUDENfT AFFECTIVE MEASURE 

Because there are no substantial differences in student affect scores at the beginning of the year, 
only the analyses with standardized change §cores and analyses of covariance with pretest score as 
the covariate were performed in the evaluation of the effects of CE on students' attitudinal develop- 
ment. The Student Affective Measure (§AM) assesses student attitudes toward learning and school. 
It was not administered to the first graders in the fall. Hence, the present analyses do not involve 
grade 1 . * 

" Differences in Attitudinal Changes Between CE and Non-CE Students 

The differences in attitudinal changes between QE and non-CE students were examined in terms of 
standardized change scores as computed from our sample data. Two sets of one-way AtslOVAs were 
performed for the six CE groups; one in terms of reading CE, and pne in terms of math CE. Table 
• 2-14 presents .the results of these analyses. . 

In terms of both reading and math CE status, we found that changes in attitudes of CE students,, 
Title I students in particular, are more favorable relative to the changes in attitudes of non-CE 
students in grade 6* These findings can not be interpreted easily considering that, for all groups of 
students in this grade, the attitude scores tend to decrease at the posttest (see Table B3-1 7 of Appen- 
dix B3). Our data suggest a smaller decline for Title I students who start with higher scores at the 
beginning of the school year. Thus, Title I students in grade 6 tend to maintain a relatively more 
positive attitude than non-CE students, but generally do not show an absolute improvement in 
attitude. 

The differences in. attitudinal changes among the six,CE groups are mostly insignificant in grades 3 
through 5. In grade 2, student affect scores tend to increase for all groups of students, and non-Title I 
CE students appear to show a greater improvement in their attitudes relative to Title I and non-CE 
students. The patterns of these inconsistent results across grades do not lend themselves to obvious 
interpretations v We suspect that the unproyen validity of the attitudinal measure in. the elementary 
schools makes it difficult to obtain meaningful results. v 

As it is likely that the higher scores for CE students largely reflect a tendency for students from 
families of low socioeconomic status to respond in a more socially desirable manner (see Report 5), 
we specifically compared the attitudinal changes between CE studehts and the groups of educa-. 
tionally needy nor^CE students. These comparisons again did not reveal appreciable differences 
except in two 'cases*. In grade 2, changes for reading CE students (particularly for other-CE students 
\ in Title I schools) tend to be more favorable in comparison with needy non-CE students in CE 
schools. In grade 6, math Title I students show more favorable changes relative to those for needy 
non-C£ students. The results of these additional analyses are summarized in Table' B2-9 of 
Appendix B2. 

The conclusion is that there are no consistent and substantial effects of CE on the development of 
student's attitude to learning and school. 

Analyses of Covariance for the Examination of Attitudinal Changes 
for CE and Non-CE Students 

. Parallel to Mie ANCOVAs in reading and math, four sets of ANCOVAs were performed for student 
affect scores. The mean pretest and posttest scores for the six CE groups in reading and in math are 
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Table 2-14 

One-VYay ANOVA of Fall-to-Spring Standardized Change Scores in 
Student Affect by Reading and Math CE Status 



Grade 



1 




2 


3 






c 
D 


) o 




• 


Reading CE Status 










Title I students 


N 

li 


2,748 


2,784 


2. t 


one 




JL , OD / 


in Title I Schools 


Mean 


.02 


-. 00 




.00 


.02 


.08 


Other CE Students 


M 
W 


869 


826 






/ JJ 




in Tifclp I Schools 


Mean . 


.15 


r.02 




.04 


-.03 


.03 


CE Students 


N 


651 


593 

j 




586 


555 


584 


in Other-CE Schools 


Mean 


-.02 


* ;00 




-.00 


.11 


.06 


Non-CE Students 


N 


5, 512 


5,609 


6, 


163 . 


6,538- 


6,597 


in Title I Schools 


Mean 


-.00 


-.00 




.00 


-.01 


.01 


Noh-CE Students 


N 


2,670 


2,731 


3, 


061 




|y*97 


.in Other-CE Schools 


Mean 


-.03 


.01 




.01 


.02 


-.02 


Students in 


N 


1,766 


1,812 


1, 


846 


2,082 


2,405 


Non-CE Schools 


Mean 


.05 


.02 




.01 


-.01 


-.02 


Total 


N 


14,216 


14,355 


14, 


690 


:5,517 


17,897 




Mean 


.01 


.00 




.00 


.00 


.01 


F Statistic 




4.97* 


.33 




.34 


2.86* 


4.50* 






Math CE 


Status 










Title I Students 


N 


1, 500 


1, 651 


1 


324 


1,268 


1,057 


in Title I Schools 


Mean 


.00 


. 01 




-.02 


.02 


.16 


Other— CE Students 


N 


725 


6/9 




799 


704 


807 


in Titlp I Schools 


Mean 


.05 


.04 




-.04 


.06 


-:oi 


CE Students 


N „. 


279 


353 




353 


375 


432 


in Other-CE Schools 


Mean 


.13 


-.04 




.01 


.06 


,15 


Non-CE Students - 


N 


,6,904 


6,889 


7 


074 


7,416 


7,447 


in Title f; Schools 


Mean 


° .02 


-.01 




.01 


-.02 


.01 


Non-CE Students 


N 


3,042 


2,971 


3 


,294 


3,672 


5,749 


in Other-CE Schools 


Mean 


-.04 


.01 




.01 


.03 


-.02 


Students in 


N 


1,766 


1,812 


1 


,846 


2,082 


2,405 


Non-CE Schools 


Mean 


.05 


, .02 




.01 


-.01 


-.02 


Total 


N 


14,216 


14,355 


14 


,690 


15,517 


17,897 




Mean 


.01 


.00 




.00 


.00 


.01 


F Statistic 




3.37* 


.92 




.54 


2. 53 


10.69* 



















* Mean standardized change scores in student affect differ significantly among the 
six analysis groups at .01 level. 
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presented in Table B3-17 in Appendix B3, along with estimates of within-group regression coeffi- 
cients. As indicated in this table, the assumption of homogeneous within-group regressions is 
satisfied in aH cases. Inspection of the means shows that the changes in affect scores from fall to 
spring tend to be smalkfo; all groups. Sometimes, the means decline at the end of the school year, 
especially in grades 5 and 6. Table B3-18 in Appendix B3 gives the adjusted group means and the 
F-tests for their differences, the results are quite similar to those obtained with the ANOVAs earlier. 
In grades 2 and 6, CE students consistently, show higher adjusted, means than those for non-CE 
students in CE schools. Other findings are mostly insignificant or do not demonstrate consistent pat- 
terns of differences among groups. 

There are few interesting findings in the other three sets.of ANCOVAs. They are also presented in 
Appendix B3 (Tables B3-19 through B3-24). 

Summary of the Effects of CE on Attitudinal Change 

There is slight evidence that CE. students maintain more favorable attitudes toward learning during 
the school year as compared with non-CE students in CE schools. Considering the inconsistent 
findings across grades, potential response biases, and the generally low reliabilities of the SAM (see 
Report 9), we conclude that there is no evidence for substantial effects of CE on the attitudinal 
development of students. 

SUMMARY OF FINDINGS 

We now provide a brief summary of the findings presented in this chapter: 

• Five different analytical approaches were applied to examine the effectiveness of CE on stu- 
dent achievement growth in basic skills. CE was found generally effective in accelerating the 
achievement growth of its participants, though the findings vary slightly with the analytical 
methods used. The positive impacts of CE on learning were observed morejrequently in 
math than in reading. In reading, CE was effective primarily in the first three grades/and also 
in grade 6; whereas in math, CE was shown to be more or less effective in all grades. The 
positive effects of CE on achievement growth were particularly noticeable when it involved 
Title 1 programs. As evidence for positive effects indicates that CE students achieve better 
than expected of them in the absence of CE services, the present results suggest that CE has 
helped in arresting and sometimes narrowing the anticipated (widening) achievement gap 
between them and tjieir non-disadvantaged peers. 

• There are few interesting findings concerning the effects of CE on students' achievement 
► growth in practical skills.' Based on the measures of the Practical AchieviementScale (PAS), 

the patterns of achievement gains over the grades differ between groups of students with dif- 
ferent educational needs. However, sucn differences may largely be attributable to the ceil- 
ing effects of the test. Comparisons with specific subgroups of non-CE student* having similar 
educational needs, however, show no differences in PAS gains between the CE and non-CE 
groups. We thus conclude that there is little evidence to indicate the effectiveness of CE on 
the practical-achievement growth of its participants.. 

] • Changes in student affect during the school year tend to be small for CE as well as non-CE 
students. Sometimes the mean affect scores decline at the end of the school year, particularly 
& in the upper two grades. Although some evidence shows favorable effects of CE on the 
development of students' attitude in grades 2 and 6, the findings are not consistent with 
other grades. We conclude that CE does not have a positive effect on the development of 
learning attitudes. 
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CHAPTER 3 

theIffects of instructiqn on the achievement 

GROWTH OF COMPENSATORY-EDUCATION STUDENTS r - 



The primary function of Compensatory Education is to* provide its participants with 
, supplementary instruction to improve their achievement. In this chapter, vte begin our 
inquiry into how CE can help the educationally deprived students achieve better by 
examining the effects of instruction on ach/evenjent. We concentrate on the amount of 
.instruction as measured by time and leave the study of other instructional dimensions to 
Part II of this report , ^. 

Assuming the validity of the fan-spread hypothesis (which assumes that achievement dif- 
ferences between groups increase over time in proportion to the increase of standard 
deviations over time), we first applied Campbell's treatment-effect correlational method to 
determine if total amount of instruction received has any positive effect on achievement 
The correlational analysis reveals that there is a positive but small relationship between 
achievement krowth and amount of instruction. As a byproduct ofexamining this relation- 
ship separately by patterns of instructipttSi services, we find that students who start with 
lower achievement receive greater amounts of services with an emphasis on instruction by 
special teachers and in small groups, while students who start higher receive lesser 
amounts and with less emphasis on such special instruction. 1 

0 In order to compare the effects of the different kinds of /nstruct/on, we divide the total 
instruction into three components; regular instruction, special instruction (characterizing 
the services received by CE students), and tutor/independent work. Multiple-regression 
and structural-relation models are then employed to examine the effects of these three 
. kinds of instruction. The analyses show that amount of special instruction in general does 
not have a positive effect on achievement regardiess of whether our analysis is concerned 
with all elementary students or is confined to a sample of disadvantaged students. By com- 
parison, amount of regular instruction tends to be positively related to achievement 
growth. As CE students generally received more special instruction and less regular instruc- 
tion (with a net total of more instruction) than non-CE students, we conclude from these 
findings that the achievement of CE students is unlikely to be accelerated as a result of 
receiving speoal instruction (instruction by special teaching staff and in small groups). 
Whatever positive impact that CE has demonstrated so far remains unexplained. We 
suspect that fruitful search for an explanation of how CE works may require the examina- 
tion of the achievement process over a longer period, and better data on What takes place 
in the special instruction (rather than on time alone). 

In Chapter 2 w*.» were concerned with the effects of CE orfrhe achievement growth of students. We 
wanted to determj&e if CE participation itself had a demonstrable effect on educational develop- 
ment. Althougtt^uch determinations are important for a comprehensive evaluation of CE, it is 
important to look beyond .mere participation to the instructional services the students receive, and 
then to relate those services to achievement growth. This more penetrating investigation is begun in 
the present chapter. The goal of such study is, of course, the prescription of particularly effective 
- services so that the educational processes called 'CE' can be improved. 

We will examine first the relationship between achievement growth and instructional services 
received during the school year by comparing the correlation between services and fall achieve- 
ment with that between services and spring achievement. The method is commonly referred to as a 
treatment-effect correlational approach. Thean?lysis is applied to the entire sample, disregarding 
* student CE status, beca jse it considers instructional services as the primary treatment that can affect 
achievement. The differences in achievement-service correlation between fall and spring is related 
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. , to the partial regression coefficient for services when the Standardized) posttest score is regressed 
on services and the (standardized) pretest ^score, with pretest-postteSt correlation as a factor for cof% 
recting the unreliability of pretest scores. Therefore, this approach in effect assesses the relationship 
between services land adjusted,£chievgment growth. (The u:e*of pretest-posttest correlation as an 
estimate of Tthe pretest reliability is appropriate if,. without special intervention, individual dif- 
ferences in achievement tend to jhcrease over time in proportion to the increase of stancjard devia- 
tion, the fan-spread phenomenon.) ^ ' V 

Second, the multivariate regression analyses are employed to determine the relative importance of 
student characteristics (including initial achievement),* and amount of instruction in explaining 
achievement growth. Emphases will be placed on the technique of commonality analysis in which 
, the proportion of variance that is^xplained by the predictors is decomposed into components that 
are unique to various set^of predictors and that are common to two or more^gts. In the absence of 
a specific causal model for the' relation between achievement and the background and educational 
variables, the commonality analyses may be used as a crude tool to assist us in making inferences 
about the relative usefulness of different sets of variables in predicting achievement gro\vth. 

Finally, we will test some structural models that relate student characteristics, CE status, and amount 
and kind of instruction to achievement. Measurement models that are important for dealing with 
fallible measures of achievement and student background will also be incorporated into these 
models. In this way, the findings from the traditional regression approach, which suffers from 
unreliability of predictor variables and lack of causai connections, are complemented by those 
obtained with a more rigorous approach that examines structural relations as well as measurement 
errors., 

«- • 

Our analyses generally reveal a small role for the amount of instruction in explaining achievement 
growth. Somewhat discouragingly, we also find that more special instruction which characterizes 
the services received by CE students generally does not result in greater growth. The understanding 
of how CE can help improve participant achievement requires further research. 

THE MEASUREMENT OF INSTRUCTIONAL SERVICES 

o 

Every student receives a wide variety of instructional services each day, ranging from planned exer- 
cises to fortuitous enlightening experiences. Therefore, in a study like this, some fundamental deci- 
sions rpust be made about how instructional services will be defined and measured. The approach 
of the study was based on the promising approaches of many recent studies (the Compensatory 
• Reading Study, Trismen et al., 1975; the ESAA Evaluation, Coulson, Ozenne, Hanes, Bradford, 
.Doherty, Duck and Hemenway, 1977; and the Instructional Dimensions Study, National Institute of 
Education, 1977b). 

The best thinking at the time was that instructional services can most effectively be assessed (by 
survey methods) in terms of time, instructor and group size. We developed two instruments (SPAR 
gnd SPAM, see Chapter 1) to capture differences on all three dimensions, so that for each student 
we could estimate the number of hours per year of instruction received from different kinds of 
instructors and in groups of different sfzes. These data were obtained separately for reading and 
math. In this chapter,, we concentrate on instructional services as measured by number of hours of 
services received. 

i 

The study has also used another, intfex of service that weights the number of hours differentially 
according to the intensity of labor involved in each arrangement and takes into account the usage of 
equipment and materials. Although this index is* expressed, perhaps misleadingly, as standard 
resource dollars (see Technical Report 6), it should be regarded simply as a transformation of the 
variables for instructional time in order lo reflect the intensity as well as thequantity of services. This 
derived scale for services is analyzed Only in the treatment-effect correlational approach. 
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In the correlational analyses we employ total hours of instruction received, .without separate don- - 
sideration of differences in instructor or group size. In other analyses, the hours of instruction 
received in each of the ten service components of the student attendance records are combined 
into three composite indicators to reflect differential emphases on types of services delivered. Based 
on earlier findings that differences between CE and non-CE students in services received are largely 
in the small-jjroup.U-b students) instruction, special-teacher instruction, and assistance by aides, 
those service components were combined to form an indicator of 'special' instructional services 
(Hs - hours of special services). The remaining service components are divided Into two sets to 
form additional ^composite indicators: one for hours in medium- and large-group instruction by 
register classroom teachers (Hr - hours of regular services), apd one for independent Work with 
tutors or in -s^idy (H| - hours of tutor/independent work). The three composites*are defined 
separately for reading and for math. " * ' • 

Asidefrom their ability to discriminate bptween CE and pon-CE students, the three composites are 
selected for use in the regression and structural-model analyses on the basis of resulfs obtained in 
our preliminary analyses. The preliminary analyses showed that the component jt^ms within each 
of the composites tend to share similar. regression coefficients (same sign in particular). The regres- 
sion analyses that include the ten original instructional components and those employing the three 
composite's result in almost identical coefficients of determination (multiple R 2 ), indicating that dif- 
ferential weighting of ttie components within a composite produce negligible contributions to the 
explanation of achievement variation. In fact, use of the total hours of instruction doesn't even 
noticeably reduce the proportion of variance in posttest scores that is explained by the model (for a 
simUar/i riding, see Report 7, where the standard-resource dollars index for each component instead" 
of number of hours is investigated). 

In addition to these preliminary results, consideration of some estimation problems that may be 
caased by excessive use^fvariables with badly |kewed distributions also motivated us to abandon 
the ten instructional items ip flavor of the composites. Explicitly^ use of predictor variables that have 
very uneven distributions (such as the individual servicfe items which have zero values for large pro-^ 
portions of studertts because'they tend to represent alternative forms of instruction) can lead to 
unstable estimations and distorted inferences. By summing items that are likely to be substitutes for 
one another, we can often alleviate the extreme skewness, 

AVR^n the total number of hours is used as_a sole'measure-of service?, its relationship with achieve- 
ment growth may differ for different patterns of service". In order to address this prob'em, we further 
define six patterns of instructional service from the three composites, separately for reading and 
math. For each student, the yearly hours of instructional services received (corresponding to each of 
"the three Composites) were divided by the total hours received per year (Hj - sum of the ten ser- 
vice components) to obtain the proportions of services received in each of the'three categories. At 
each grad*, the distribution of each of the three proportionS-was dichotomized at its projected 
population talue (see Table CM in Appendix CI for th^ values), so thgt each student's indicator - 
was described as being above the population meain (+) or below it (— ). Of the eight potential pat- 
terns of service*(total number of premutations of three +'s and/or -'s), two occur orily in rarexases ^ 
where all three proportions are equal to the population values. Theref&re, only six patterns are. 
employed in the analyses to control for differences in the service configurations. The rationale for 
defining the service t patterns in this way is that for the same' amount of instruction, differential 
emphases of the three kinds of instruction may lead to different effects. ^ 

In.passing, it should be noted that not only do tKe hours of services received in various service com- 
ponents not completely reflect the quality of services, they also Ha not show if the services are 
directly aimed at improving the basic skills measured by the achievement tests administered. The 
issue of effects of curriculum bverlap with test content on achievement scores is not addressed here 
for lack of n^qessary information. Our goal is to ascertain the role of educational services in improv- 
ing the basic-skill achievement of CE students. The achievement tests were selected §o that they 
measure basic skills that are common to a variety of curricula. 

' ♦ * C) ■ • 
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It should also be noted that we do not have accurate information for adjusting any potential effects 

* of different time intervals between the pretest and posttest. However, there was no evidence that 

the schools had deliberately altered the testing dates, and therefore substantial differences in time 

intervals were not expected. The relationship of instructional services and educational practices 

with educational development will be examined further in later chapters, especially in Part II of this 

report. 
> 

INSTRUCTIONAL SERVICES AND ACHIEVEMENT GROWTH - A CORRELATIONAL 
APPROACH 

» 

Campbell (1971) suggested a correlational approach for determining the presence of a treatment 
effect by comparing the correlations between the treatment-group membership and the criterion 
measure at the pretest and the posttest time. Under the fan-spread hypothesis and assuming no 
treatment effect, the two correlations should be equal, and therefore a significant difference 
between them would indicate an effect. The idea of this technique can be traced back to Woodrow 
(1939) and, in fact, it has been employed to evaluate the effects of treatments of a quantitative 
" /nature. 

The* method. is easy to understand, and has been successfully applied to continuous treatment 
variables by Coulson (1972) in the initial screening of program variables for inclusion in the re- 
analyses of Headstart evaluation data. 

In the current context, amount of services constitutes an educational treatment that varies con- 
tinuously, and the achievement score serves as a criterion measure. We have chosen this simple 
correlational method as our first approach to the investigation of the effects of instructional services 
on achievement growth. Hotelling's (1940) t test is applied to the difference in correlations in order 
to detect the effects of treatment. 

Specifically, if one considers CE as an 'all-or-none' treatment, the comparison of treatment-posttest 
correlation with treatment-pretest correlation leads to a comparison of the mean standardized gain 
^cores between the treatment and no-treatment groups. In reality, the kind of treatment varies 
'extensively within CE programs and so does the amount of treatment. Stemming from a belief that 
an increase in instructional services results in the acceleration of learning, the intention of CE pro- 
grams is to provide supplementary instruction to educationally disadvantaged students in order to 
improve their achievement. It follows that the concept of 'treatment' (i.e., instructional service) in 
CE is very much a continuous one. 

An extension of the analysis of standardized gain scores to this situation would be to compare the 
correlations between the continuous treatment variable and the outcome measure for the students 
at the pretest and posttest time. As greater amounts of services are received by CE students who are 
generally lower achievers in comparison with non-CE students, we would expect the correlation 
between achievement and amount of services to be negative at the pretest time. However, if the 
^_ relative achievement standings of low-achieving students^are improved as a result of additional ser- 
vices provided to them, the negative correlation will decrease (become smaller in size) or even 
become positive at the posttest time. 

Conceptually, unless through its association with differences in initial achievement status, student 
characteristics, instructional services, and other program characteristics (to be studied in Part Jl of 
this report), the mere labeling of students as CE or non-CE students cannot account for differential 
growth between them. If we are to believe that supplementary services can really help CE students 
attain greater achievement and thereby justify CE programs, we first have to confirm empirically the 

1 ' idea that more services lead to greater growth. 

,! 

x . In order to control for differential effects among the different service patterns, the analyses are 
reported for each of the six subsamples corresponding to the six patterns of service described 
"earlfeKOne may object to such apalyses on grounds that the correlations may be reduced due to 
• * \ V 
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the restricted ranges of variables. But because the patterns are defined in terms of proportional 
distributions of the total hours of services over the three sets of service items rather than the hours of 
service per se, within each pattern, total hours of services still vary widely. 

There is a possibility that the groups with emphasis on instruction ir. small groups and by special 
teaching stafi; would have restricted test scores on the basis of previous findings showing that these 
services are generally provided to CE students. Even if this is the case, the analysis should not be 
invalid because our interest is not in the size of the correlation, but in the differences between cor- 
relations. Moreovei, our results indicate that there remains considerable variation in total hours of 
services, pretest scores, and posttest scores for each subsample of service patterns. (Nevertheless, 
the results should be interpreted with consideration of the possible effects of restricted ranges, as 
the variances do decrease in some groups.) 



Table 3-1 presents the correlations between total hours of instructional services and pretest and 
postteSfachievement for each of the six service patterns, and for all patterns combined. Hotelling's t 
statistic for the significance of the difference between each pair of {non-independent] correlation 
cpefficients is also provided in the table. As we are interested in the direction of the change in cor- 
relations, a value of + 2.33 for the t statistic indicates significant (at the .01 level) and positive effects 
of instructional services on achievement. 

In the interpetation of the findings from Table 3-1, the reader should be reminded that the number 
of hours of services does not reflect the quality or content of instruction. As a supplement, parallel 
analyses are performed using the standard-resource-dollar index for services, which takes into 
account the intensity of services by assigning higher values to instruction received in smaller groups 
and from teachers of higher qualifications. However, this alternative index still does not measure 
directly tfie quality of services, and the pattern of its correlations with achievement remains similar 
to' that using number of hours as the index. Similar results of these additional analyses are sum- 
marized in Table CI -2 of Appendix CI. 

c 

Earlier analyses revealed that CE students received more hours of instructional services with few 
exceptions (see Technical Reports) and that they generally received services of higher intensity (see 
Report 6) than did their non-CE counterparts. Hence, if the present findings support the contention 
that more hours of services (or more intensive services) result in greater achievement growth, we 
can infer that CE students who receive more services are likely to have greater growth than their 
peers who receive less services. 

The results of our analyses can be summarized in four different ways, and it is enlightening to con- 
sider each. 

Sen/ices and Achievement Growth by Grade. For both measures of instructional services and in both 
reading and math, analyses with the total sample consistently show positive overall effects in the 
upper three grades. The findings are inconsistent for grade 1 in reading and for grade 3 in math 
when different measures of services are employed. But the relationships between achievement 
growth and instructional services ar* mostly positive for these two grades. By contrast, no significant 
effects of instructional services are obtained for the total sample in grade 2. 

Services and Achievement Growth by Reading and Math. Analyses with the total sample and with 
the subsamples by instructional patterns reveal similar relationships between achievement grov>th 
and instructional services for reading and math. Among all subsample analyses in the six grades, 15 
positive relationships for reading and 17 for math are found to be significant (at the .01 level), when 
number of hours of instruction is used as the measure. In terms of the standard-resource-dollar 
index, the results showeight significances°for reading and ten for math. As there are 36 analyses in 
each set, these data give support for a positive relationship between services and growth only in 
about one-half or fewer of the cases. The more frequent occurrences of significant and positive rela- 
tionships in the analyses of the total sample are probably artifacts of the large sarrple sizes. 



Table 3-1 

Changes in Correlations Between Achievement and Number of Hours of Instruction Received 
During ttie Year, for Subsamples of Students Classified by 
Pattern of Instructional Services 



Grade 



Correlation Between 
Amount of Services 
and Pretest/Posttest 
Achievement 



Subsample&'by 
Pattern of Instructional Services * 



Total 
Sample 



Reading Achievement and Services 



Pretest 


. 01 


-.01 


• 11 


.06 




. 04 


— . 07 


. 04 


Posttest 


.06 


.02 


. 12 


. 12 




.07 


- . 01 


. 08 


t ** ! 
diff 


4.30 


1.65 


0.29 


3.90 


1 


.85 


3.65 


6.73 


Pretest 


-.03 


.02 


.09 


-.01 




.06 


.07 


m 

. Ul 


Posttest 


-.05 


.07 


.09 


- .01 




.03 


. 04 


.02 


t . ** 
diff 


-2.05 


4.05 


-0.10 


0.11 


2 


.81 


-1.55 


1.42 


Pretest 


-.09 


-.01 


-.07 


-.03 




.16 


-.04 


-.08 


Posttest 


-.11 


.02 


-.10 


-.00 




.16 


.02 


-.07 


t ** 

c diff 


-1.73 


2.10 


-1.64 


1.55 


0 


.02 


5.28 


2.16 


Pretest 


-.10 


-.10 


-.13 


-.13 




.09 


-.21 


-.17 


Posttest 


-.08 


-.09 


-.22 


-.13 




.C8 


-.16 


-.16 


t ** 

c diff 


2.76 


0.27 


-4.24 


-0.42 


1 


.05 


4.92 ' 


2.89 


Pretest 


-.09 


-.22 


-t 22 


-.08 




.15 


-.18, 


-.17 


Posttest 


-.07 


-.18 


^ 20 


-.06 




.14 


-.15 


-.15 


t ** 

c diff 


3.69 


3.tf7 

/ 


1.38 


2.41 


0.38 


2.57 


5.64 


Pretest 


-.13 


-.26 


-.28 


-.08 




.13 


-.26 


-.19 


Posttest 


-.10 


-.23 


-.23 


-.07 




.13 


-.26 


-.16 


t ** 

c diff 


5.47 


3.24 


3.69 


1.00 


1 


.02 


0.28 


6.59 



Math Achievement and Services 



1 



2 



3 



4 



5 



6 



Pretest 




.04 


-.02 


.05 




. u 7 


.08 


.01 


-.03 


Posttest 




.00 


.05 


.10 




.05 


.14 


.05 


.01 


t ** 

c diff 


2 


.17 


4.19 


2.05 


1 


.73 


2.73 


2.52 


6.59 


Pretest 




.03 


-.12 


-.12 




.11 


.08 


-.13 


-.04 


Posttest 




.09 


-.09 


-.05 




.12 


.05 


-.00 


-.03 


t ** 

diff 


-4.60 


1.46 


2.40 


0 


.72 


-1.44 


7.63 


0.68 


Protest 




.02 


-.05 


-.03 




.00 


-.03 


-.01 


-.04 


Posttest 




.02 


-.03 


-.14 




.07 


-.02 


.00 


-.03 


c diff 


0 


.17 


1.48 


-4.30 


5 


.78 


0.56 


1.06 


2.47 


Pretest 




.06 


^ -.07 


-.11 




.02 


.03 


-.17 


-.10 


Posttest 




.03 


-.02 


-.02 




.03 


.07 


-.11 - 


-.00 


c diff 


2 


.37 


2.56 


3.75 


1 


.38 


2.18 


4.56 


7.44 


Pretest 




.02 


-.12 


-.17 




.12 


.01 


-.18 


-.12 


Posttest 




.01 


-.09 


-.14 




.06 


.02 


-.13 


-.09 


c diff 


0 


.86 


1.85 


1.36 


5 


.56 


0.84 


4.00 


6.41 


Pretest 




.01 


-.06 


.01 




.05 


.03 


-.12 


-.05 


Posttest 




.03 


-.02 


.07 




.02 


-.00 


-.12 


-.03 


t ** 

c diff 


2 


a 


2.76 


2.70 


2 


.99 , 


-1.69 


-0.07 


4.15 



The hours of instruction received during the 1976-77 school year were employed to form six patterns of 
instructional services. The instructional services were grouped into three kinds: regular instruction 
<by classroom teachers in groups of 7 or mors), special instruction <by special teachers, paid aides/ 
assistants, or by classroom teachers in groups of 1-6J, and tutor/independent work. Three variables 
representing the proportions of hours of instruction received in each of the three kinds of services 
were created and then each was dichotomized at the corresponding estimated population value. Because , 
the proportions sum to 1.0, aix mutually exclusive patterns of services were obtained on the basis of 
three dichotomies, excluding the rare cases where each proportion was equal to its respective cutoff 
imostly due to roundings) . In the Table, a '+' indicates the proportion is above the cutoff, while a 
•-• indicates a value below the cutoff. The instructional patterns are represented by the three indexes 
of '+/-' for regular instruction, special instruction, and tut or /independent work (arranged from left to 
right). For example, the pattern ■+--» indicated that the proportion of regular instructional time is 
above its cutoff, while the proportions of special instruction and tutor/independent work are below 
their respective cutoffs. 
**Hotell<ng , s t statistic for the difference between the pair of correlations. 
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Services and Achievement Growth by Measure of Services. With 32 positive associations for hours of 
service and only 18 for standard-resource-dollar index in the subsample analyses, it appears that 
number of hours is a more sensitive indicator of growth-related services. However, no contradictory 
findings between the two measures of service are apparent. 

Services and Achievement Growth by Instructional Patterns. Combining the results across measures 
of service and grades, significances ofpcfcitive relationships are found most frequently for the ser- 
vice pattern that represents high proportions of special instruction and independent work, but a low 
proportion of regular instruction ('- + +' in the table). The pattern for which significances are found 
least frequently is one that represents low proportions of special instruction but high proportions of 
the other two kinds of instruction ('+-+' in the table). 

Additionally, it may also be observed from Table 3-1 that, in reading, the correlations between the 
pretest score and amount of service become more negative in the upper three grades. There is a 
similar but less clear trend in math. This observation suggests that there is a tendency to allocate ser- 
vices.according to student's need in the upper grades, especially in reading. 

An added benefit of these correlational analyses by service pattern is that the descriptive data allow 
us to examine the relationship between achievement of students and the pattern of services they 
receive. We present the mean pretest scores, VSS gains, and amount of services received for each 
group of students associated with the six service patterns in Tables CI -3 and CI -4 (in Appendix CD 
for reading and math, respectively. The data in these tables are also displayed graphically in Figures 
3-1 and 3-2. 

From these figures, we find that students with low test scores tend to receive services that are 
characterized by a high proportion of special instruction (patterns '+ + - ' and + - '). With some 
exceptions in the first two grades, students receiving services in these patterns tend to receive more 
total hours of services. In contrast, students with high test scores generally receive services that are 
characterized by a Jow proportion of special instruction (patterns ' + - + ' and - + '). These latter 
group* of students also tend to receive fewer total hours of services. Furthermore, the standard- 
resource-dollar index of total services is highest for the pattern that heavily emphasizes special 
instruction ('- + - ), and lowest for the patterns that de-emphasize special instruction ('- - + and 
'+-+'). 

Inspection of the length of the vertical lines connecting the pretest and posttest means, however, 
shows no clear tendency for students in any particular service pattern to have a greater growth rate. 
It seems that average raw gains (in VSS units) are not very sensitive to the effects of amount of 
instruction, perhaps because preexisting differences in factors that affect learning have not been 
adjusted properly. 

In summary, the analyses of treatment-effect correlations reveal that: 

• A positive and significant but quite small relationship exists between achievement growth 
and amount of services received. That is, with pretest differences controlled, slightly greater 
growth results from receipt of more services. 

• The positive relationship between achievement growth and services is evidenced more fre- 
quently when number of hours of instruction is employed as the index for total services than 
when the standard-resource-dqllar index is used. 

• Overriding the relationship between achievement growth and services received, different 
amounts and patterns of services are provided to students of different initial achievement 
status. Students who start with lower achievement receive greater amounts of services in pat- 
terns emphasizing special instruction while students who start higher receive lesser amounts, 
with less emphasis on special instruction. 
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Subsaaples by Instructional Patterns 

(The three indexes of '+/-' used to designate each pattern 
show high/low proportions for regular instruction/ special 
instruction, and tutor/independent work, respectively). 

Figure 3-1 

Fall-to-Spring Reading Achievement Growth by Grades and 
Instructional Patterns (Numbers in Parentheses Are Average 
Hours of Total Instruction Received in the 1976-77 School Year). 
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, v Sample 

Subsamples by Instructional Patterns 

(The three indexes of '+/-' used to designate each pattern 
show high/low proportions for regular instruction/ special 
instruction/ and tutor/independent work, respectively) . 

Figure 3-2 

Falko-Spring Math Achievement Growth by Grades and 
Instructional Patterns (Numbers in Parentheses Are Average 
Hours of Total Instruction Received in the 1976-77 School Year). 
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INSTRUCTIONAL SERVICES AND ACHIEVEMENT GROWTH— 
A REGRESSION APPROACH 



An assumption underlying the correlational analysis is that, with the same educational experiences, 
individual differences in achievement increase proportionally to the increase in the population stan- 
dard deviation. That is, individual differences remain constant over time if the differences are 
expressed in units of standard deviation at each time. For the purpose of later reference, let us 
define standard scores for achievement as the observed score (in VSS units) divided by the popula- 
tion standard deviation at f he time of testing. Then if the standard scores for two individuals vary by 
x points at the pretest, they will again differ by x standard-score points at the posttest. The difference 
between their observed scores, however, may be greater at the posttest if the standard deviation 
becomes larger. 

The assumption is, that in the absence of special intervention, individuals learn at different rates, 
such that the population standard deviation varies with time, but individuals maintain similar dif- 
ferences relative to it. 4 ^A phenomenon consistent with this assumption is that high-achieving 
students learn at a greater pace than low-achieving students so that individual achievement growth 
curves spread out like an open fan. Hence, the term 'fan-spread' hypothesis is coined to explain the 
widening achievement gap between these two groups of students. The 'fan-spread' hypothesis is 
frequently accepted ^n an intuitive basis, although it is only partially supported by the observed in- 
crease of the standard deviation for achievement scores with grades. 

Under this hypothesis, gains in standard scores are equjal for all individuals sharing the same educa- 
tional experiences. A simple model for examining effects of educational variables then is to assume 
a linear relationship between gains in standard scores and these variables, in the correlational 
approach, such a model wate adopted to study the relation of achievement growth to instructional 
services received. Specifically, we postulated a regression model for gains in standard scores on 
total instructiopal time. It can be shown that the regression coefficient in this model is proportional 
to the differences between the correlation of pretest achievement with instructional time and that pf 
posttest achievement with instructional time. The proportional factor is the ratio of the standard 
deviation of posttest scores to that of instructional time. Thus, the effects of instructional services on 
achievement can be assessed in terms of this correlational difference. A substantial increase 
(positive becoming more ppsitive and negative becoming less negative) in the correlation between 
achievement and instructional time from pretest to posttest indicates a positive effect. 

The correlational analysis accounts for the effects of differential learning rates in accordance with 
tne fan-spread hypothesis. Consequently, it controls only for the pretest achievement differences 
and ignores potential direct effects of other student characteristics on learning. In this section, we 
refine our investigation of instructional effects by using both initial achievement and student 
characteristics to control for individual differences. Because there is no clear evidence for the 
stringent assumption of invariant individual differences in standard scores over time, the fan-spread 
hypothesis is not followed in the formulation of the new model. The relationships between posttest 
achievement and the control variables are simply assumed to be linear and additive. Furthermore, a 
linear relationship between the adjusted achievement growth and instructional services is assumed 
in order to assess the instructional effects. Thus, the current analysis employs a multiple regression 
model for posttest achievement on pretest achievement, student characteristics, and amount of 
instructional services. 

One problem with the additive model is that it assumes a homogeneous relationship between 
instructional services and achievement growth for students with different initial achievement and 
background. In reality, there are often interaction effects between instruction and the control 
variables. That is, the same amount of instruction need not result in an equal amount of learning for 
the educationally disadvantaged and non-disadvantaged students. Lower-achieving students who 
often come from families with disadvantaged backgrounds are expected to require greater efforts to 
learn similar material* ..ding to this problem are the negative relationships of instructional services 
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received with initial achievement arrd student background. If the adjustments for the preexisting dif- 
ferences in achievement and background are inadequate (mostly due to measurement errors and 
omissions of relevant variables), the practice of allocating more services to disadvantaged students 
could produce inadvertently a negative bias in the estimation of instructional effects. As a result, if 
instruction has positive but sma effects, the model may fail to show them, or worse, may show 
negative effects. 

One way to alleviate this problem is to introduce interaction terms into the model. However, this 
remedy can be inadequate because of the restriction to linear relations and because of the col- 
linearity between the interaction and main terms. A better way to deal witK the difficulty is by 
analyses of subsamples. Thus, the present analyses are focused on relatively homogeneous sub- 
.samples of students who are comparable with respect to initial achievement and background. Con- 
sidering the special interests of this study, we included in the analysis only CE students (who, by vir- 
tue of their receiving CE services, were probably educationally deprived in some respects) and com- 
parison non-CE students who were judged as needing CE by their teachers (and were found to 
achieve at similar levels as their CE peers, see Chapter 2). In this way, we hope to reduce the chance 
of finding negative instructional effects that are due to inappropriate analytical models. 

Within this sample of students, the control variables are used primarily to remove as much 
systematic variation of the posttest achievement as possible so that the model is sensitive to the 
effects of instruction. For the same purpose, we further add four dummy-coded grouping variables 
to differentiate between students in terms of their CE statuses. By entering these grouping variables, 
between-group variation can also be removed in the estimation of disturbance variance. 

Here, CE status can be employed to provide additional information on educational disadvantage 
that has not been contained in the background variables already used in the model, and educa- 
tional experiences in areas other than instructional time (such as teacher's behavior in class, or 
school's environment). The effects of these unmeasured differences among groups are summarized 
by the regression coefficients for the dummy variables (sometimes known as intercepts). These coef- 
ficients are interpreted as group differences in achievement" growth after adjusting for differences in 
initial achievement and background. 

Analyses Method 

In short, the present analysis assumes a multiple-linear-regression model for posttest achievement 
on pretest achievement, background characteristics and amount of instructional services. Four stu- 
dent characteristics that were found to be useful predictors of posttest achievement in previous 
analyses (see Chapter 2) were employed: white/minority status, participation in free or reduced- 
price meals, mother's educational attainment, and teacher's judgment of need for CE. Instructional 
services were measured by the time spent in the three instructional settings explained earlier in this 
chapter. The three composite measures of services were entered into the model, instead of the total 
instructional time, in order to examine their differential effects on learning. 

The analysis sample was divided into five groups (hence four grouping variables were needed): 
Title I students, Other-Ce students in Title I schools, Other-CE students in Other-CE schools, needy 
Non-CE students in CE schools, and needy Non-CE students in Non-CE schools. For detailed 
descriptions of these groups, see Chapter 2. The students involved were regarded as educationally 
disadvantaged either because they were receiving CE or because they were judged as needing CE. 
The within-group regression surfaces were assumed to be parallel. 

The analyses were aimed at determining if the instructional services were the primary mediating fac- 
tors for learning. If this were the case, we could provide supplementary services to the students hav- 
ing special educational needs with the expectation that their performances would improve. Other- 
wise, we might find positive effects of CE, but could not understand how it works. In this situation, 
some might conclude recklessly that selection for CE alone produces miracles, disregarding what 
efforts are put into the program. Such a conclusion should be carefully avoided to prevent the 
danger of relegating CE to a perfunctory role in education. 
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The analyses were performed for reading and math separately. Except for three of the student 
characteristics (white/minority status, participation jymeal programs, and mother's, educational 
attainment), all other variables were defined specifically for reading and for math. In addition, 
similar analyses were also performed for the Practical Achievement Scale (PAS). In the analyses for 
the PAS, both sets of composite measures foe reading and math instructional services were 
employed, and judged need for CE was redefined as having CE need in either reading or math. New 
categories of CE/comparison status were also defined for the analysis of practical acMevement (see 
Table C1-5 of Appendix CI for an explanation of these categories); 

Results of the Analysis 

The results are presented in two ways. First, the regression coefficients are examined to assess the 
direct effects of instructional services. If they are the primary underlying variables that mediate 
achievement growth, they will have positive and large coefficients. Additionally, the coefficients for 
the grouping variables (i.e., the intercepts) can be used to compare mean adjusted achievement 
growth among groups. A positive coefficient indicates that the corresponding group achieves a 
higher mean adjusted growth than the reference group (in our analyses, needy non-CE students in 
non-CE schools serve as the reference group). Significant coefficients for the grouping variables that 
represent CE students imply that CE has some independent effect on learning (probably due to dif- 
ferences in quality of services, educational practices, and other unmeasured student characteristics, 
overadjustmentof preexisting differences, or perhaps even Hawthorne effects). 



Second, we are interested in studying the joint effects of different sets of variables (background, 
amounts of services, and CE/comparison status). In the absence of an explicit causal model to 
describe the interrelationships among the independent variables, the joint effect may be described 
by means of the commonality analysis. The commonality analysis partitions the variance of the post- 
test scores into various components: unique to each set of variables, and shared by two or three sets 
of variables. For details of the rationale and computational procedures for the analysis, the reader 
may refer to Mood (1971), Newton and Spurrel (1967), and Wisler (1968). 

Our objective is to assess the unique contribution of instructional services to the explanation of 
posttest variation. If the instructional services can independently explain the differences in achieve- 
ment growth, the unique component for the set of service variables will be substantial. On the other 
hand, if the effects of different sets of variables are highly correlated, the common components will 
dominate. In this case, it will be difficult to determine the role of instructional services in effecting 
achievement growth. 

The Direct Effects of Instruction on Achievement Table 3-2 presents the zero-order correlations (r) 
and the standardized regression coefficients (j3) for the analyses of reading (top half) and math (bot- 
tom half) achievement. Similar data for the analyses of the PAS are provided in Table 3-3. Among 
the three service variables, only the amount of regular instruction demonstrates a positive and 
significant (at the .01 level) relationship with achievement growth. Positive effects of regular instruc- 
tion are shown in grades 1 and 2 for reading and in grades 2, 4, 5, and 6 for math. The amount of 
special instruction shows a significantly positive effect only in grade 4 for math. 

Turning to the coefficients for the grouping variables, it can be seen that, among CE students, Title I 
students benefit most from CE services. They frequently achieved an average adjusted growth 
exceeding that for the comparison Non-CE schools (in the lower two grades for reading and in all 
grades but grade 4 for math). While these latter findings are consistent wifnthe positive effects of CE 
found in Chapter 2, the lack of evidence for substantial effects of instructional services leaves us little 
comfort. Amount of instruction, particularly of the special instruction which characterizes the ser- 
vices received by CE students, is not strongly related to achievement growth. 

The results for the PAS are mostly insignificant except in grade 4 (see Table 3-3). As remarked in 
Chapter 2, the insensitivity of the single-level test to the progress in practical achievement at later 
grades may explain our inability to find sizable effects. 
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Table 3*2 c 

Predictor-Criterion Correlations and Standardized Regression Coefficients for the Regression of 
Reading/Math Posttest Score on Pretest Score, Student Background Characteristics, Hours of 
Instructional Services Received, and CE/Comparison Categories* 



\* Correlation with Posttfst Score (r) and Standardized Regression Coefficients (6) 

Predictor I ■ , 

Variables • Grade 1 Grade 2 Grade 3 Grade 4 Grade 5. Grade 6 
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Reading Achievement N ■ 


4,298 




526 


4 


306 


J 


698 


3 


807 


4 


109 


Pretest VSS Score 


.56 


.49** 


.68 


.59** 


.72 


.65** 


.74 


.67** 


.78 


.74** 


.80 


.75** 


Student Background Variables 


























White/Minority status 


.04 


-.07** 


.22 


.07** 


.22 


.04** 


.22 


.04** 


.21 


.03** 


.29 


.05** 


Free-Meals Participation 


-.12 


-.02 


-.24 


-.08** 


-.25 


-.04** 


-.26 


-.03** 


-.26 


-.07** 


-.28 


-.04** 


Mother's Educational Attainment 


.25 


.10** 


.23 


.05** 


.27 


.08** 


.23 


.06** 


.21 


.03** 


.25 


.05** 


Judged Need for Reading CE 


-.32 


-.14** 


-.33 


-.09** 


-.34 


-.07** 


-.32 


-.08** 


-.20 


-.04** 


-.26 


-.05** 


instructional Services Received 


























Regular Instruction 


.12 


.09** 


.16 


.08** 


.08 


.00 


.10 


.02 


.03 


.03 


.07 


.04** 


Special Instruction 


-.07 


.01 


-.15 


-.02 


-.20 


-.03** 


-.19 


-.02 


-.18 


-.01 


-.23 


-.01 


Tutor/Independent 


.04 


.01 


.06 


-.00 


.08 


.00 


.06 


.03 


.11 


.02 


-.03 


.02 


CE/ Comparison Categories 


























Title I/Title I 


.06 


.11** 


-.07 


.06** 


-.08 


.05 


-.10 


.00 


-.10 


.03 


-.13 


.02 


Other-C£/?itle I 


.10 


.04 


.16 


.05 


.12 


.03 


.08 


-.01 


.07 


.02 


.15 


.02 


, Ot her-C£/ Other -CE 


.03 


.02 


.04 


.05** 


.04 


.03 


.05 


-.01 


.04 


.04 


-.06 


-.03 


S Needy Non-CE/CE 


-.10 


.06** 


-.04 


.04 


.02 


.05** 


.03 


.01 


.06 


.04 


.08 


.03 


Hath Achievement N ■ 


3,203 


3, 


217 


3, 


425 


3 , 


255 


3 f 


342 




598 


Pretest VSS Score 


.57 


.50** 


.65 


.58»* 


.63 


.58** 


.68 


.66** 


.71 


.68** 


.72 


.69** 


Student Background Variables 


























White/Minority Status 


.02 


-.03 


.12 


.02 


.17 


.06** 


.15 


.00 


.11 


.03 


.11 


.02 


Free-Meals Participation 


-.08 


-.03 


-.13 


-.03 


-.17 


-.07** 


-.20 


-.06** 


-.15 


-.04** 


-.13 


-.02 


Mother's Educational Attainment 


.18 


.04** 


.18 


.05** 


.14 


.05** 


.17 


.03 


. 13 


.01 


.16 


.03 


' Judged Need for Math CE 


-.33 


-.10** 


-.34 


-.13** 


-.28 


' -.11" 


-.27 


-.03 


-.25 


-.04** 


-.26 


-.07** 


Instructional Services Received 


























Regular Instruction 


.03 


.03 


.05 


.07** 


.04 


.04 


.06 


.06** 


.12 


.08** 


.09 


.06** 


Special Instruction 


-.03 


-.00 


-.08 


-.02 


-.08 


-.05** 


-.06 


.07** 


- :i 


-.01 


-.09 


.02 


Tutor/Independent 


-.01 


.02 


.06 


.00 


.02 


.01 


.09 


.06** 


-.01 


.03 


.01 


.04** 


CE/Cottpar£son Categories 


























Title 1/Title I 


.09 


.12** 


-.01 


.06** 


.03 


.10** 


-.01 


.02 


-.00 


.06** 


.01 


.05** 


Other-CE/Title I 


.17 


.07** 


.17 


.04 


.10 


.00 


.14 


.02 


.13 


.03 


.13 


.03 


Other-CE/Other-CE 


.10 


.06** 


.08 


.03 


.04 


-.01 


-.00 


-.07** 


.02 


.03 


-.03 


-.03 


Needy Non-CE/CE 


-.16 


.04 


-.07 


.05** 


-.08 


.01 


-.05 


.02 


-.02 


.04 


-.01 


.03 



The student background characteristics employed in the Analysis aro co ^^ as follows: White/Minority Status 
(1 - Caucasian-White; 0 - Minority), Free-Meals Participation (1 - Participant of free or reduced-prico meals; 
0 ■ Non-participant), Mother's Educational Attainment (1 - High school graduation or more; 0 ■ less than high 
school) , and Judged Need for CE (1 ■ Need CE? 0 - No need) . Instructional Services Received and CE/Comparison 
categories are subject-specific variables (see* the text for description of these variables). 

** 

*Q*«<Mte» that the regression coefficient is significantly different fron zero at the .01 level. 

ERIC -. 
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Table 3-3 

c 

Predictor-Criterion Correlations and Standardized Regression Coefficients 
for the Multiple Regression Analysis of the Practical Achievement Scores* 



Correlation with Posttest Score (r) 
and Standardized Regression Coefficients (6) 
Predictor Variables for 



the Posttest Score Grade 4 Grade 5 Grade 6 



N - 

Pretest Practical Achievement Score 

Student Background Characteristics 

White/Minority status * 
Free-Meals Participation 
Mother's Educational Attainment 

Judge4 Need for Reading and/or Math CE 

« 

Instructional Services Received in Reading 

Regular Instruction 

Special Instruction 

Tut or /Independent 
instructional Services Received in Math 

Regular Instruction 

Special Instruction 

Tutor/Independent 

CE/Comparison Categories 
Title I/Title I 
Other-CE/Title I 
Other-CE/Other-CE 
Needy Non-CE/CE 



4, 


304 


4, 


244 


4 


,584 


.62 


.56** 


.67 


.62** 


.68 


.63** 


.21 


.07** 


.19 


.05** 


.22 


.06** 


-.21 


-.04** 


-.20 


-.05** 


-.21 


-.02 


.19 


.05** 


.19 


.03** 


.22 


.08** 


-.25 


-.11** 


-.23 


-.06** 


-.18 


-.05** 


.07 


.00 


.03 


.02 


.08 


.03 


-.15 


-.04 


-.15 


-.02 


-.22 


0 -.03 


.03 


.02 


.08 


.03 


.04 


.03 


.07 


.11** 


.04 


.02 


.05 


.04 


-.09 


.06** 


-.13 


-.01 


-.13 


-.01 


.07 


.06** 


.04 


.02 


.05 


.03 


-.08 


.01 


-.09 


.04 $ 


-.11 


r 04 


.06 


-.00 


.07 


.03* 


.07 




.03 


-.02 


' .02 


.02 


-.02 


' .01 


.03 


.03 


.05 


.07** 


.09 


.04 



Ihe Practical Achievement Scale was' administered to grades 4, 5, and 6 only. For 
descriptions of the background variables , see Table 3-2* The CE/Comparison Categories* 
were defined on the basis of the student joint status in reading and math CE. 
Table Cl-5 of Appendix CI explains how these categories are obtained.* The service 
variables are described in the text (in the section entitled 'The Measurement of 
Instructional Services' t page 3-4). 
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Returning to Table 3-2, it can be seen that the pretest score is obviously the most powerful predictor 
of achievement, followed by judged need for CE. Race/ethnicity (white/minority status) and 
economic status (participation in meals program) are not as important in predicting achievement in 
math as in reading or in the PAS. 

/nterpretat/on of Findings. The absences of positive pffects for special instruction led to the suspicion 
that because special teaching staff often were hired with CE funds and their jobs tended to be 
unstably they might be less qualified than the regular staff. However, there was little evidence in 
previous studies to support this contention. For instance, the NIE (National Institute of Education) 
survey of Title 1 districts revealed that districts selected Title I teachers usually on the basis of 
academic training and experiences with educationally disadvantaged children, but rarely on the 
basis of seniority (NIE, 1978). The NIE study also found that CE teachers tended to have higher levels' 
of educational attainment and more recent training experiences than homeroom teachers. Despite 
these findings, the doubts remained. In order to cle^r suspicion, we compared the qualifications 
between regular classroom and special teachers. 

In the Teacher Questionnaire, Parts B and C, the teachers were asked to indicate what type of 
reading/math teachers they were: (1) regular classroom teacher; (2) special teacher. providing 
instruction to students during the regular class period; or (3) special teacher providing instruction in 
addition to that received by students during the regOlar class period. The teacher's self-classification 
can be partially verified by data from the Student* Participation and Attendance Record and the 
Student-Teacher Linkage Roster. A teacher's response was accepted only if he/she provided some 
instruction of the specific type to at least one student, for instance, a -special teacher should be 
linked to at least one student whose record showed receipt of non-zero hours of instruction from 
special teachers (regardless of the size of instructional group). Teachers whose responses could not 
be confirmed by their students' attendance records were excluded from the analysis. 

• » < • 

The analyses were performed for each grade and for reading and math separately. All teachers who 
provided some reading (math) instruction to at least one student in a given grade were included in 
the respective dialysis for that grade. By grades, about 5 to 9 percent of reading teachers and about 
12 to 15 percent of math teachers were deleted from the particular analysis because their responses 
were inconsistent with their students' records of instructional services received. 

Five variables taken from the Teacher Questionnaire, Part A, were used to describe the teachers' 
qualifications: (1) number of years teaching in any fthool (total teaching experience); (2) number of 
years teaching in current school; (3) highest earned college degree; (4) number of college courses 
taken in teaching reading/math; and (5) number of hours of inservice training in reading/fnath dur- 
ing the previous three years. These data are summarized in Table C1-6 of Appendix CI. 

Th analyses show that special teachers generally do not differ from regular classroom teachers in 
their total teaching experience, but tend to have taught fewer years in the current school. The 
teachers on the average haye about 1 1 years of teaching experience, a result corroborating the data 
reported by the National Education Association (1977). The three types of math teachers are not dif- 
ferent with respect to their academic degrees earned. By contrast, special reading teachers tend to 
have attained higher degrees than regular teachers. 

Consistent differences between special and regular teachers are obtained in terms of their training! 
Special teachers clearly have received more inservice training than classroom teachers. This finding 
is expected in light of the policy that districts may use CE funds to provide inservice .training to 
teachers, especially to those serving CE students. In addition, special teachers also have taken more 
college courses in teaching their specific subjects. 

Our analysis thus far showed that the overall qualifications of special teachers were in fact higher 
than that of the regular teachers. The failure to uncover positive effects of special instruction cannot 
be blamed on the low qualifications of the teachers. We suspect that the presentstudy may involve 
too short a time interval to demonstrate strong effects of instruction, that the \cts of instruction 

» O 
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require a longer period to manifest themselves. This suspicion awaits confirmation in a subsequent . 
report (Report 15) which analyzes the three-year data, Additionally, the inverse relationship 
between service allocation and achievement level also tends to mask v/hatever positive effects the 
instructional services might have on the achievement growth of the disadvantaged students. 

Finally, it may be noted that the positive relationship between the total instructional time and 
reading achievement growth in grades 4 and 5/as evidenced in the correlational analyses, is \iot 
shown in the multiple regression analyses. The discrepancy between the findings may be explained 
by the different samples involved in the analyses. To some extent, the significant result in the earlier 
analyses for'thg entire sample may be explained by the large sample size. However, it is quite pos- 
sible that the positive relationship may not exist for.the educationally deprived students. This latter 
conjecture is compatible with the observation that in spite of more instruction received by CE 
students in these two grades, they have not shown significantly greater progress than that for the 
comparison Non-CE students who received less instruction (see Chapter 2). What is needed to 
improve the achievement of these students may be effective teaching rather than time. 

The joint Effects of Instruction and Student Background. In order to provide some information on the 
joint effects of the background variables and instructional services, the variance of posttest scores is 
partitioned into unique and shared components in Table 3-4. The unique contributions by the set of 
service variables (set B), and the set of CE/comparison grouping variables (set C), are very small. 
Most of the contributions by these two sets of variables are made jointly with the set of pretest and 
background variables (set A), as indicated by the larger common components for sets A and B, and 
for sets A and C. Clearly, pretest achievement and background characteristics are the dominating 
factors for explaining the posttest-score variation. In fact, pretest score alone accounts for most of 
the explained posttest variance (ranging from 31 to 64 percent for reading, 32 to 52 percent for 
math, and 38 to 46 for PAS). , \ 

SUMMARY AND CONCLUSIONS 

The multiple regression approach gives the following results: 

• There is no striking evidence that amount of instruction is the primary factor that mediates 
achievement growth. Amount of Regular instruction is the only kind of service found to be 
positively related to growth. 

• Consistent with the results of Chapter 2, CE programs often show positive impacts on the^ 
achievement growth of their participants, Title I students in particular. The positive but small 
impact is observed more frequently jn math than in reading. However, little is known about 
the underlying mechanism that explains these small effects. 

To conclude our discussion, we would like to emphasize that the relatively slight explanatory power 
we find for the amount of the three kind$ of instruction should not cause despair in the educational 
community. The following thoughts may make the point: 

• Increased amount of services may be critical for rafting the achievement level of low- 
achieving students, even if we have not yet been able to show a clear and strong relationship 
between the amount of instruction and achievement growth. It is possible that increased ser- 
vices do help accelerate the growth rate of these students, but the amount is still not enough 
to overcome their severe educational disadvantage. This could be the situation especially for 
reading in the upper grades, where extensive effort could be required in order to compen- 
sate for the accumulated,deficiencies in the reading skills of CE students. The receptiveness 
of su£ h students to increased or improved services and the ability ordesire of society' to pro- 
vide them as speculative investments are, of course, \5ther important considerations. 

♦ 

• It is reasonable to think that improvement in the quality of services, not just the amount, will 
result in greater effects on achievement growth. The mission for us, then, is to continue our 
efforts in identifying and developing better kinds of instructional services. 
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Table 3-4 

Partition of the Proportion of the Posttest Score Variance Accounted for by Pretest Score and 
Student Background Characteristics, Instructor al Services Received, and CE/Comparison 
Categories for the Three Croups of CE Students, and Two Groups of Non-CE 
Students judged To Be in Need of CE 



1 

Grade 


Proportion of Posttest Score Variance Accotinted for by the Disjoint Components 
of Variance: A « Pretest and. Student Background Characteristics, B « Yearly 
Hours of Instructional Services Received, and C = CE/Comparison Categories* 


i ' 

Squared t 
Multiple * 
Correlation 


unique tu 


Unique to Unique to 
B C 


Shared by 

A and B 
But Not C 


Shared by 

A and C 
But Not B 


Shared by 

B and C 
But Not A 


Shared by 
A, B and C 


Reading Achievement 

i 
2 
3 
4 
5 
6 


.3061 
.'4247 
.4770 
.5029 
. 5674 
.5727 


.0073 
.0070 
.0010 
.0014 
.0010 
.0016 


.0046 
.0012 
.0009 
.0002 
.0008 
.0017 


.0170 
.0313 
.0431 
.0381 
.0364 
.0435 


.0285 
.0322 
.0223 
.0149 
.0125 
.0266 


-.0002 
-.0005 
-.0001 

.0003 
. .0001 

, 0000 


- 

-.0085 
-.0014 
-.0021 
.0005 
.Q050 
.0114 


1C A Q 
AQA C 

r>ni ** 
. _>boo 

.6575 


Math Achievement 














9 




1 


.2740 


.0013 


.0067 


.0087 


.0689 


-.0003 


-.0084 • 


. 3509 


2 


.3785 


.0058 


.0018 


.0140 


.0561 


- . 0007 


-.0077 


.4478 


3 


.4011 


.0048 


.0080 


.0114 


.0192 


- . 0025 


-.0065 


.4355 


4 


.4472 \ 


.0059 


.0057 


.0118 


.0147 


.0004 


-.0004 


.4853 


5 


.4568 


.0046 


.0019 


.0271 


.0269 


-.0001 


-.0067 


.5105 


6 


.4914 


.0020 


.0021 


.0192 


.0267 


.0000 


-.0071 


.5343* 



Practical Achievement 

4 .3798 .0107 > .0015 .0217 .0053 .0006 .0014 .4210 

5 .4191 .0079 .0015 .0257 .0067 .0008 .0040 .4607 

6 .4^97 .0058 .0008 .0401 . .0104 .0000 *0087 .4855 



Variables in Set A are Pretest Score and the four student characteristics. Set B consists of the compos ite„ measures 
of instructional services in reading and/or math. Set B contains the four dummy-coded grouping variables for 
CE/Comparison Status. See Tables 3-2 and 3-3 for listings of these variables. 



INSTRUCTIONAL SERVICES AND ACHIEVEMENT GROWTH— 
A STRUCTURAL-RELATION MODEL APPROACH 

In Chapter 2, where we evaluated the overall effects of CE, and in 'the preceding sections of this 
chapter where we relied on regression approaches to examine the relationship between instruc- 
tional services and achievement growth, a single test score was employed as the measure of 
achievement at a given time (pretest and posttest). The CTBS vertical-scale'score obtained with the 
y 'SDC recommended' test level (see Chapter 1) was used in those analyses? One of the major con- 
cerns in such analyses is the measurement errors of test scores, particularly when they are used as 
\covariates or regressor variables. 

To deal with the problem of measurement errors eiplicitly, one needs multiple observations on the 
same variable. In the first year of data collection for this study, two adjacent levels of CTBS are, 
assumed to measure the same thingT-achievement, and thus enabieus to equate the tests on the 
basis of the double-testing procedure. On this same basis, it is reasonable to consider the two test 
scores as two indicators of a same construct (achievement at the time of test). We may then formu- 
late a measurement model assuming the two levels of tests are congeneric. A set of tests are con- 
generic if they measure the same thing (i.e., their 'true' scores are linearly related, Joreskog, 1970; 
1971). With such a model we may estimate test reliabilities and examine relationships between 
achievement and other variables after removing the measurement errors from the test scores (the 
error-free scores are often referred to as 'true' scores). 

The use of both test scores from the two levels in the analysis also addresses the concern that dif- 
ferent test levels employed in different schools may introduce spurious test effects in the assessment 
of student achievement. The practice has the advantage of basing the construct of achievement on a 
wider range of test content and thus of being more appropriate for a broader spectrum of cur- 
riculum. Therefore, the analyses in this section will utilize the double test scores at each test admini- 
stration to measure achievement. 

Related to th$ measurement issue is the concept of a background factor that constitutes an impor- 
tant element in achievement models. This factor is frequently referred to as socioeconomic status or 
socioeconomic index. In o^r earlier analyses, a number of student-background variables available 
in the Student Background Checklist (SBC) were entered into the same regression model cqpcur- % 
rently in order to study their relations to achievement growth. With such an approach, there is no * 
simple index for the joint relationship of these variables with achievement. In light of a general 
acceptance of the concept of a socioeconomic index, it is desirable to postulate a common factor' 
(latent variable) to represent these background variables. Then we can examine the influence of 
socio-background (social origin) on achievement in terms of the hypothesized common factor (con- 
struct). To this end, a measurement model that defines a socio-cultural advantage factor (SCAF) on 
the basis of the background variables is incorporated into the present analyses. 

Explicitly, a dichotomous variable for Race/Ethnicity (non-Hispanic whites vs. minorities) serves as 
an indicator that reflects one's cultural origin. A second dichotomous variable for partif ipation in 
free or reduced-price meals serves as an indicator that represents the economic aspect of the com- 
mon factor. This indicator is a proxy of family income, family size, and type of family (farmor qpn- 
farm) because it is determined on the basis of these criteria. A third observed indicator is mother's 
educational attainment which *s believed to affect the educational climate and social environrpent 
in the home. These three aspects of the factor are related to the child's initial achievement and con- 
tinuing educational growth in some joint manner. 

Aside from measurement problems, the earlier regression analyses also suffer from the limitation of 
revealing only the direct relations between the dependent and independent variables. There is little 
information on the role of the interrelationship amQng the independent variables in the determina- 
tion of the relationship between each of them and the dependent variables. Traditionally, the 
technique of path analysis (Wright, 1934, 1960; Tukey, 1954) is employed to sort out the complex 
interrelatioffs among the variables. This approach employs a form of simultaneous multiple regres- 
sion analysis, and is referred to generally as causal modeling or linear structural modeling. (Path 
analysis only deals with manifest variables and does not solve the problem of measurement errors.) 
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However, recent methodological advances by Jtfreskog and his colleagues have made possible an 
integrated approach to the problem of measurement errors and the modeling of linear structural 
relations by embedding ordinary path analysis in a factor analytic framework (Jb'reskog, 1969, 1970, 
1973, 1974, 1978; JbVeskog and Coldberger, 1975; JSreskog and Sbrbom, 1976, 1977). Thus, struc- 
tural relations among 'error-free' variables (latent constructs) are represented by simultaneous 
linear equations; and measurement errors of the indicators (observed variables) are estimated with 
factor analytic models. Bentler (1980) provides a thorough review of the development and appli- 
cations of this method. A computer program 'L1SREL IV (Joreskog and Sbrbom, 1978) can be 
.employed to find solutions for a general family of linear structural relation (LISREL) and measure- 
ment models. The program has greatly facilitated the application of Joreskog's model to real data. 

For our present purpose, the LISREL IV program was applied Jo obtain solutions (estimates of 
parameters in the model) for achievement models that simultaneously address the issues of 
measurement errors and examine the interrelations among achievement, student background, and 
receipt of instructional services. Two models were formulated in order to help us understand the 
role of instructional services in effecting achievement growth. 

General Description of the Analytical Models 

The first model is a path-analytic model with both latent and observed variables for a single popula- 
tion. The model is applied tp the data from the entire first-year sample with a specific interest in 
estimating the direct effects of amount and kind of instruction received on achievement growth. 
However, it may not be appropriate for examining the effects of instructional services on the 
achievement of CE students because of the problem of selection bias. With a special interest in the 
achievement,growth of disadvantaged students, we employ a second model to study a restricted 
sample that includes only CE students, and non-CE students who are judged as needing CE. The 
neecjy non-CE students serve as comparison groups in t the analyse because of their similarity to CE 
students with respect to achievement status and background. 

The policy of compensatory education generally requires schools to provide additional services to 
students with special educational needs. Tfcese students are low achievers and often come from 
low-income families, so there are large background differences between them and 1 their non- 
disadvantaged peers. In light of such differences, CE students are expected to leariVat a slower pace 
in the absence of special assistance. This kind of selection bias.(the differential growth rates, in par- 
ticular) cannot be adequately adjusted with the linear, additive model for the total sample. The best 
way to deal with the problem is to incorporate an explicit model for the selection process into the 
analysis so as to account for the bias. 

Unlike the econometric studies, a satisfactory and technically tractable model for the selection pro- 
cess in CE has not been developed because of its great complexity. (A brief discussion of the current 
selection policy will be pfovided later.) Under this circumstance, an effective strategy to cope with 
the problem is to control for the large preexisting differences by employing comparison groups that 
have characteristics similar to the CE groups. Then a similar model can be applied to analyze the 
data from the comparison and the target groups simultaneously. We thereby aim at reducing poten- 
tial selection biases so that the effects of instructional services and the role of CE can be examined 
properly. 

The second model is an ANCOVA (analysts of covariance) model with latent variables as proposed 
by Sbrbom (1978). It allows examination of within-group relationships between variables and com- 
parisons of factor means (means for latent variables) among groups. The focus of this model is to 
compare the differences in posttest achievement between CE and comparable non-CE students after 
adjusting for their differences in pretest achievement, socio-background, and receipt of instruc- 
tional, services. If differences in adjusted posttest achievement still exist, we suspect that other 
variables, in addition to preexisting differences in initial achievement and^ackground, stud dif- 
ferences in amount of services received, are also responsible for explaining achievement growth. 
This information combined with the estimates of the direct effects of instructional services on 
achievement will provide insights into further search for the underlying factors in the transmission of 
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* achievement status from one timp to another. We have a special interest in the effects of instruc- 
tional services because they are the variables most directly regulated in CE policy as implied by the 
'Supplementary Service' clause in the Title I guidelines. Other variables such as classroom practices 
are less subject to explicit regulation. 

, Additionally, the second model allows us to compare means for the pretest achievement factor, for 
the socio-cultural advantage factor, and for amount of services received between CE and rioh-CE 
students. Such comparisons can be used to describe the effectiveness of CE targeting and its relation 
to allocation of services. 

Detailed descriptions of the two models will be given later when their results are discussed. 
However, it is helpful to note at this point that all variables involved in the current analyses have 
been explained earlier in the beginning of this chapter. The only exception is that scores from the 
two adjacent test levels, instead of only those from the recommended level, are included in the 
analyses. This addition to the data is required in order to examine the measurement errors of test 
scores. 

Another comment on the data is that we have treated the three composite variables of services as 
'error-free'. It should be noted that they are inappropriate to serve as multiple indicators of a 
general construct underlying amount of services received, because they often represent alternative 
forms of services rather than duplicative measures of services. This characteristic is evidenced by 
the negative correlations among them, particularly between the amounts of regular and special 
instruction. 

It is possible to argue for using the four sets of service data collected in four bimonthly intervals dur- 
ing the year as multiple observations so that teachers' reporting errors may be removed by means of 
the measurement model. This strategy was not adopted for several reasons. For example, the pat- 
terns of instructional services need not be stable over time— instructional arrangement may be 
changed according to progress in thacurriculum and student needs, or there may be a rotation of 
the arrangements among students. Attendance which directly affects actual receipt of services may 
also vary with season. Another consideration is that excessive computer time may be required for 
the LISREL program to converge to a solution when the model involves large numbers of 
parameters. For practicality, we think that the accumulated amount of services received during the 
period is'reasonably accurate and relevant to total learning in that interval. We therefore prefer to 
enter each of the three service composites directly into the structural relation m.odel without 
hypothesizing a latent variable for them. 

Technical Considerations of the Analytic Approach 

Before we turn to a detailed discussion of the analyses, it is helpfc to address some of the common 
technical problems in fitting the models. The first concern in the application of the LISREL IV pro- 
gram is the robustness of the parameter estimates with respect to departures from multivariate nor- 
mal distributions. Specifically, many of the variables in the model are discrete. Although Jbreskog 
(1978) has called for efforts to investigate models involving discrete variables, little progress has 
been made in this area. The distributional problem. can be particularly acute in the hypothesized 
socio-cultural advantage factor based on three dichotomous variables. 

For an empirical examination of the robustness characteristic in models where latent variables are 
defined in terms of discrete variables, see Olsson (1979). In general, one expects some lack of fit for 
the model to result from the distributional violations. In connection with the same issue, it is also 
inappropriate to regard the measurement model as one that deals with observation errors. In this 
case, however, our intention is to extract a comrpon factor and then to examine the relations of 
these variables with other variables in terms of this factor. For this reason, we specifically use the 
term 'unique factor' in place of the term 'measurement error' in the usual LISREL formulations. 

Another important issue is the problem of specification error. In any modeling process, whether it 
deals with fallible or latent variables, omission of variables that interrelate with some of the variables 
in the system can introduce biases to the estimates of the parameters in the model. As we frequently 
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are forced to leave out important variables due to lack of observed indicators in the data base, we 
have to be very cautious in drawing conclusions from the results of our models. For instance, the 
ability factor (some may prefer to use the terms 'aptitude' or 'intelligence'), which partially deter- 
mines a student's achievement status and thereby relates to selection for CE services, pretest 
achievement, and posttest achievement, is not measured in the study and not included in our 
model. 

Perhaps the most difficult issue is the philosophy of model fitting. Our stance is that the building of a 
model should be strictly guided by theory and that the model fitting serves onjy as a confirmatory 
process. Once the structural relations are specified in the model to reflect the theory, one may pro- 
ceed to obtain a solution for the model (i.e., to obtain estimates of the parameters) in order to 
examine the agreement between the theory and the data. 

A dilemma in our present application js that the asymptotic X 2 measure of goodness of fit is 
extremely sensitive when the data involve a large sample size (N). Slight departure of the model 
from the data can lead to its rejection because theX 2 statistic is directly proportional to N. In this 
case, Joreskog (1969, 1978) suggests that the statistical problem be viewed as one of comparing the 
fit of a sequence of hierarchical models to decide on the selection of the models, instead of one of 
rejection or confirmation of a given model. He also advises the model selection should not be 
decided purelyon a statistical basis. We strongly agree with his emphasis on the importance of the 
investigator's interpretations of the data based on substantive, theoretical, and conceptual con- 
siderations. Accordingly, we choose to focus our attention on the meaning of the resulting 
parameter estimates. 

Occasionally, hypothesis testings are made in order to gauge the statistical significance of a coeffi- 
cient or of differences among groups. In such cases, we adopt a stringent criterion for the rejection 
of the null hypothesis. For the most part, however, we will deemphasize the importance of the 
overall fit of the model and concentrate our discussion on the implications and usefulness of the 
model for explaining achievement. / 

A General Path Model for Reading and Math Achievement 

One of the major purposes of CE is to provide supplementary services to its participants in the belief 
that the additional assistance will have beneficial effects of accelerating their achievement growth. 
Accordingly, we are especially interested in examining the role of CE in raising the achievement 
level of its participants in terms of its effects on service allocation and the effects of services on 
achievement growth. To this end, we postulated a path model to describe the interrelationship 
among student CE status, receipt of instructional services, and socio-backgrouhd, and the roles of 
these factors in the transmission of achievement status from the beginning to the closing of a school 
year. 

The model, as depicted in Figure 3-3, is applied to data for each of the six grades, and for reading 
and math, separately. We employ the data from the entire sample to appraise the usefulness of this 
model in furthering our understanding of the achievement process. For the benefit of technical 
readers, mathematical formulations of this model are provided in Appendix C2. 

Following a convention of structural-relation modeling, we use rectangles to denote observed 
variables, while ellipses are used to indicate latent variables. When there is only a single indicator 
for a latent variable, no error term can be estimated. In this case, the latent variable is technically 
indistinguishable from its observed indicator. The latent variables are connected with arrows to 
show their structural relations. A single-headed arrow indicates a specific direction of the relation, 
while a double-headed arrow indicates a non-directional relation. 

A directional relation can be interpreted as a causal chain in the theory: the variable at the origin 
exerts some direct influence on the variable to which the arrow points. A non-directional relation is 
stipulated in two situations: when the variables indeed have mutual influence on each other, or 
when both variables are related to some other common variables which have been left out in the 
system because of lack of data. In addition, directional arrows are drawn from the latent constructs 
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Yearly Hours of 
Instruction from 
Special Teachers, 
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Yearly Hours of 
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(The model applies, to data for grades 3 through 6. For grades 1 and 2, the two correlations between measurement 
errors for test scores are replaced with a single correlation between the measurement errors 
for at-level pretest and below-level posttest scores) 




Figure 3-3 

Description of the tatti Model for Reading and Math Achiev 
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and 'error' variables (common and unique factors, respectively) to the observed indicators to repre- 
sent the measurement structure of the constructs (i.e., the observed indicators are linear combina- 
tions of the common and unique factors). c 



Description of the Path Model. The essential components of the model and the hypothesized 
structural-Telations among them are explained below: 

• As illustrated in Figure 3-3, a dichotomous variable based on student's CE record is used to 
show whether a student was selected for any Otiervices in the 1976-77 school year. Selec- 
tion for CE services is assumed to have some direct effects on receipt of instructional services 
in three different settings (regular, special, and tutor/independent). In turn, these three ser- 
vice variables are assumed to have direct effects on posttest achievement. 

• Because one's socio-backgroundfrequently affects the type of education one receives (Blau 
and Duncan, 1967; Duncan, 1968; and Coleman, 1975), it is reasonable to stipulate a socio- 
cultural advantage factor that influences receipt of services. The socio-cultural advantage fac- 
tor (SCAF) is hypothesized on the basis of three aspects of home background: cultural 
(Race/Ethnicity), economic (with participation in free or reduced-price meals as a proxy), and 
educational (with mother's education as a proxy). This factor is likely to exert influence on 
receipt of services through its relationship with the type of school one attends (and thus the 
resources available). Because the school factor is absent in our simplified model, the SCAF is 
assumed to have direct effects on instructional services received. Hence, there are some 
indirect effects of SCAF on posttest achievement as a consequence of its influence on receipt 
of services. . r 

• The SCAF is considered as a determinant of pretest achievement, because all three aspects 
underlying th ; s factor are related to home environment for previous outside-school learning 
and prior experience in schooling. The earlier (pretest) achievement is expected to have a 
major role in determining the later (posttest) achievement. Therefore, a direct path from 
pretest achievement to posttest achievement is specified in the model. Thus, the model also 
examines the indirect effects of the SCAF on posttest achievement through its association 
with pretest achievement. 

• Besides the indirect effects of SCAF on posttest achievement in terms of its relations with 
otfier variables in the model, it is assumed to have some direct effects on posttest achieve- 
ment. The addition of a direct path from SCAF to posttest achievement stems from the con- 
sideration that it reflects the current home environment for continuing outside-school learn- 
ing. Moreover, it may be related to aspects of schooling (e.g., peer group characteristics and 
qualification of teachers in the school) other than amount and kind of instruction received. 

• Based on a similar rationale, direct effects of CE status on posttest achievement are hypothe- 
sized to account for other CE effects that are not mediated by receipt of services. By doing so, 
we in fact regard the dichotomous CE-status variable not only as a factor that determines the 
delivery of supplementary services to the participants, but also as a proxy of all unmeasured 
variables (Heckman, 1978) that represent the differences ; n characteristics of educational 
process experienced by CE and non-CE students during the year. 

• As explained earlier, scores on two adjacent levels of CTBS tests serve as double indicators 
for achievement at a given time (pretest and posttest). When two scores are obtained with a 
same test level, their erjror factors may be correlated (Sbrbom, 1975). Therefore, the model 
indicates a correlation between the errors for at-level pretest and below-level posttest scores 
for grades 1 and 2. For grades 3 through 6, correlated errors are assumed between the two at- 
level scores and between the two below-level scores. 

The above discussion leaves two components in the model that still require explanation. First, the - 
relation between CE-status and SCAF is specified to be non-directional. Second, there is a direct link 
between pretest achievement and CE status. In order to justify these specifications, we need to have 
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some knowledge of howCE programs are implemented. We now provide some explanation for our 
decision regarding these two paths: 



• The common practice of CE programs, and Title I in particular, is to allocate funds to districts 
and schools primarily on the basis of an economic criterion (e.g., percentage of students 
from low-income families). Within the schools, students are, however, selected for CE ser- 
vices primarily on an educational basis (e.g., low-achieving). Thus, the relationship between 
CE status and student background is not a simple unidirectional one. Rather, the background 
factor can affect the kind of school a student attends. If a child enrolls in a school that pro- 
vides CE services, he/she may then be selected to receive CE on the basis of achievement 
status (or educational need). In the light of this indirect connection between background and 
CE status, we choose to examine only their intercorrelation without indicating the direction 
of the relation. 

• Regarding the CE selection criteria within schools, our informal survey indicated that schools 
frequently based the selection on achievement scores in the previous year (particularly in 
spring) and teacher recommendations. In the first study year, the pretest results were not 
available to the schools in time to be used as a reference for that year's selection. Instead, 
participation in CE suggests a low-achieving status in the previous year. The close tie bet- 
ween CE status and previous achievement, which is a determinant of pretest achievement, 
makes it reasonable for us to argue for a direct role of CE in predicting pretest achievement. 

• On this basis, we add a direct path from CE status to pretest achievement in order to account 
for their relationship. In this vein, CE status is viewed as a proxy both of achievement prior to 
the pretest and of other unmeasured background characteristics that can affect learning. The 
advantage of having this explicit path in the model is that it allows us to separate the direct ef- 
fects of CE on posttest achievement from its indirect effects. CE status has a direct effect on 
posttest achievement when it is regarded as representing special educational experiences 
unrelated to instructional time. It has an indirect effect on posttest achievement by virtue of 
its role in determining pretest achievement. 

It is important to remark that a reversed direction for the path between CE status and pretest 
achievement apparently is more acceptable to many because they believe that achievement status 
causes selection for CE but not vice versa. The problem with this idea is that it misplaces the tem- 
poral order of events: in actuality, selection for CE services precedes the pretest, especially for the 
first year of the study. Besides, the assumption that pretest achievement determines CE status and 
not vice versa results in unadjustment for indirect effects of CE on posttest achievement via pretest 
achievement in the estimation of its direct effects. 

Clearly, a more complete paradigm for CE status would include previous year's achievement in the 
model so that the cause of CE selection can be directly examined. In this case, both SCAF and 
previous achievement would be related to pretest achievement. Alternatively, we may stipulate an 
ability factor that determines CE status. Because our data base lacks these kinds of information, we 
have to settle for a less complete system in the present model. At the same time, we shall bear in 
mind the ensuing specification biases and interpret the results cautiously. 

Finally, we note that as the results of earlier analysis suggest some small relationship between 
achievement level and receipt of services, one may be inclined to hypothesize direct influences of 
pretest achievement on amounts of instruction received in different settings. However, we think 
that the correlation between achievement and receipt of services is largely attributable to the asso- 
ciation between achievement in previous years and selection for compensatory services. Specifi- 
cally, low-achieving students are selected to receive CE which, emphasizes instruction by special 
teaching staff and in small groups. Because the total amount of time for instruction is likely limited 
by school hours, a substantial increase in one kind of instruction may require a decrease in other 
kinds. Thus, through its relationship with CE selection, previous achievement exerts some indirect 
influences on the allocation of time to different kinds of instruction. In turn, pretest achievement, 
being closely related to previous achievement, shows some correlations with time allocations. 
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In addition, it is possible that earlier achievement could have some direct influence on service 
allocations. Because we have no measure of earlier achievement prior to this study, one may be 
tempted tosubstitute pretest achievement for earlier achievement and stipulate a causal connection 
between pretest achievement and receipt of services. We resisted this. temptation based on con- 
sideration that service allocations tended to be determined before the pretest. Instead, our service 
measures \nclude the amounts of services received in the four to six weeks prior to the pretest. 
Therefore, the present model does not explicitly specify a direct path from pretest achievement to 
the service variables. The relations between earlier,achievement and receipt of services, however, 
can be more adequately studied with the three-year data in a subsequent report. 



Another concern in connection with receipt of services is the interrelationships among the three 
kinds of instruction. As remarked above, receipt of instruction in one kind may indirectly affect 
receipt of other kinds, particularly when different kinds of instruction are considered alternative 
methods of delivery by the school. The present model accounts for such interrelationships among 
the service variables primarily in terms of the roles of CE status and socio-cultural advantage factor 
in the allocation of services. 

From our description of the model, it is obvious that we have not followed rigorously the ideal 
mode of a confirmatory analysis. Only when there is a well-controlled experiment, can the invest- 
igator formulate a structural model unambiguously to confirm or repudiate the causal relations 
stipulated by a theory. In educational research, we are far from having a good foundation for 
building a causal theory to explain the achievement process. This and the lack of experimental con- 
trol in a survey study fordp us to take a more flexible position here. We construct a model based on 
our best knowledge and within the limitations of our data. Our objective is not to prove a theory but 
to improve our understanding of the factors that affect learning. Moreover, a model that looks at a 
very small segment (less than eight months of schooling) of the long-term achievement process can 
hardly be adequate for testing a comprehensive theory underlying the process. Thus, our analysis 
should be viewed more as an exploratory than a . confirmatory, theory-testing effort. The results of 
our analyses are presented below. 

Fit of the Path M&del for Reading and Math Achievement As remarked at the beginning of this sec- 
tion, goodness of fit for the model is not the focus of the analysis. In view of the large sample size (N) 
involved (over 10,000 in each case), we do not anticipate the model to fit well by any conventional 
probability levels. Nevertheless, we present the X^statistics and the associated degrees of freedom 
(d.f.) in Table 3-5 for the interested reader. 

To provide a reference for assessing the fit, we calculated a hypothetical N such that if a statistic 
were obtained with this fictitious N and the original data, the model would not be rejected at the .10 
level. The hypothetical sample sizes are given in the 'Reduced N for Fit' column in Table 3-5. For 
reading, these entries show that if the input covariance matrices in our analyses were generated by 
samples of size around 500 (ranging from 349 to 827 in the six grades), instead of the original N, the 
model would be judged reasonably adequate. For math, the required fictitious N ranges from 637 to 
997. 

Our experience with the data suggests that a random sample of 500 frequently generates a 
covariance matrix very similar to that obtained with the entire sample. Moreover, inspection of the 
residual covariance matrix shows only small discrepancies between the observed and the fitted 
data. Consequently, we feel that the results can be usefu I for describing the effects of various factors 
on achievement and their interrelations with each other. 

In passing, it may be noted that theX2 statistic (with same d.f.) is uniformly smaller for math than for 
reading. Considering the negligible differences in sample sizes, the result indicates a better fit of the 
model for math data. This might be because reading achievement is a more complex process in that 
there is a greater opportunity for learning to read outside the school and thus a greater number of 
non-school factors to exert influences on reading achievement. 
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Table 3-5 

Goodness of Fit of the Path Model for Reading and Math Achievement 



Actual 2* d f * Reduced Reduction 

N* X N for Fit* Factor for N* 
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3 Achievement 
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34.2 
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10,997 
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10,995 
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19.2 
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450.68 
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827 


13.1 
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11,600 


727.89 


25 


548 


21.2 


6 


13,253 


813.00 


25 


560 


23.6 
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* 


Achievement 






1 


11,883 


557.98 


26 


757 


15.7 


2 


10,973 


391.18 


26 


997 


11.0 


3 


10,989 


430.49 


25 


878 


12.5 


4 


10,821 


447.73 


25 


831 


13.0 


5 


11,585 


625.29 


25 


L 637 


18.2 


6 


13,226 


633.75 . 


25 


717 


18.4* 



♦Actual N = sample size for the data that generate the covariance matrix 
for the analysis; x 2 = measure of fit; d.f. = degrees of freedom; 
Reduced N for Fit = if the same covariance matrix were based on a sample 
of this size, the model could not be rejected at the .10 level in light 
of the obtained x 2 * Reduction Factor for N = Ratio of the Actual N 
to the Reduced N for Fit\. 



The present model actually includes two parts: the measurement model for latent variables (SCAF 
and achievement), and the model for structural relations among the variables (latent and observed). 
Thus, it is convenient for us to present the results for these two parts separately. 

The Constructs of Achievement and the Socio-Cultural Advantage Factor. There are three submodels 
describing the relationships of the observed indicators with their respective latent variables. Scores 
on two adjacent levels (at-level and below-level) of CTBS tests are employed as double indicators of 
achievement at a particular time (pretest and posttest administrations). Essentially, the two different 
test levels are assumed congeneric (Lord and Novick, 1968). The third latent variable is the socio- 
cultural advantage factor (SCAF) that represents a common factor underlying three home 
background variables (Race/Ethnicity/ participation in free or reduced-price meals, and mother's 
educational attainment). The estimates of the regression coefficients in the measurement models 
are presented in Table 3-6. * 

One advantage of the measurement model for achievement is that it permits us to verify the 
equatability of the different levels of CTBS tests. Because vertical scale scores (VSS) derived from the 
equating procedure (see Technical Report 9) are used in the analysis, the regressions of the two test 
scores on the latent achievement variable should be the same if they have been perfectly equated. 
With t he scale of the latent achievement variable fixed at that for the below-level test, the two levels 
are considered to be equated on a same scale if the regression coefficient for the at-level test is close 
to 1.0. 
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Table 3-6 

Regressions of Observed Indicators on Latent Variables and Proportions of Variance Explained 
by the Measurement Model in the Path Analyses for Reading and Math Achievement 



Latent Posttest • Pretest Socio-Cultural 

Variable (POST) (PRE) Advantage Factor (SCAF) 

Grade 

I Observed Be low- At Below- At Rac e/ Free-Meals Mother * s 

Indicatort Level Level- Level Level Ethnicity Participation Education 



Reading Analysis 

Regression Coefficients 
(Lambda) 



1 


1.00*. 


1.12 


1.00* 


.75 


1.00* 


-1.37- 


.81 


2 


1,00* 


1.01 


1.00* 


1.22" 


1.00* 


-1.32 


.76 


3 


1.00* 


1.33 


1.00* 


.95 


1.00* 


-1.21 


.71 


4 


IjOO* 


.97 


1.00* 


.89 


1.00* 


-1.32 
-1.22 


.77 


5 


1.00* 


1.09 


1.00* 


1.01 


1.00* 


- .66 


6 


1.00* 


.96 


1.00* 


.90 


1.00* 


-1.18 


.66 



Proportion of Variance Explained 
( Rel iabi 1 i ty /Communa 1 i ty ) 



1 


.80 


.77 


.63 


.31 


.31 


.54 


.24 


2 


.85 


.76 


.75 


.85 


.35 


.55 


.23 


3 


.80 


.80 


.94 


.70 


.39 


.52 


.22 


4 


.90 


.86 


.93 ' 


.79 


.35 


.56 


.22 


5 


6 .87 


.90 


.91 


.86 


.39 


.54 


.19 


6 


.94 


.84 


.95 


.81 


.40 


.52 


.19 



Math Analysis 



Regression Coefficients 
(Lambda) ' 



1 


1.00* 


.97 


1.00* 


.82 


1.00* 


-1.33 


.78 


2 


1.00* 


.98 


1.00* 


1.01 


1.00* 


-1.25 


.68 


3 


1.00* 


1.61 


1.00* 


.96 


1.00* 


-1.20 


.65 


4 


1.00* 


1.06 


1.00* 


.75 


1.00* 


-1.34 


.74 


5 


,1.00* 


1.35 


1.00* 


.98 


1.00* 


-1.25 


.65 


6 


,1.00* 


1.06 


1.00* 


.91 


1.00* 


-1.31 


.69 


Proportion of Variance Explained 
















(Rel iabi 1 ity/Communal i ty) 
















1 


.80 


.75 


.72 


.46 


.32 


.53 


.23 


2 


.81 


.79 


.78 


.78 


.38 


.54 


.20 


3 


.66 


.93 


.79 


.81 


.41 


.53 


.19 


4 


.89 


.74 


.96 


.63 


.36 


.57 


.21 


5 


.84 


.77 


.92 


.72 


.39 


.55 


.18 


6 


.86 


.84 


.85 


.72 


.37 


.57 


.18 



tEach of the two latent variables for achievement has two indicators: Vertical Scale Scores on two adjacent levels of 
CTBS (below-level and at- level* see Table 1-2 of Report 9 for test levels administered) . The indicators for the Socio- 
Cultural Advantage Factor are coded as following i Race/ethnicity (1 ■ Caucasian/white; 0 - otherwise); Free-Meals 
participation (1 - participant; 0 - non-participant); and Mother's Education (1 - High School graduate or atbove; 

"jtf ■ otherwise) . 

\9 d parameters in the model for the purpose of defining the scales of the latent variables. 
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As shown in the table, the two adjacent test levels have more or less equivalent scales in most cases. 
But there are a few exceptions. Examination of the score distribution (see Report 9) suggests that, in 
general estimates of the regression coefficient substantially greater than 1.0 for the at-level test are 
often obtained if there are noticeable ceiling effects of the corresponding below-level tesUas in the 
case of below-level reading pretest for grade 2, below-level posttest for grade 3 in reading, and 
below-level posttest for grades 3 and 5 in math). On the other hand, estimates of the regression 
coefficient substantially smaller than 1.0 for the at-level test indicate that the at-level test is too dif- 
ficult and exhibits some floor effects (as in the case of at-level pretest for grade 1 in reading, and at- 
level pretest for grades 1 and 4 in math). 

Another advantage of the measurement model for achievement is that separate estimates of 
reliability become feasible for the different test levels. In classical test theory, reliability is estimated 
in terms of the correlation between two parallel tests. In reality, parallel test forms are rarely 
attainable. Consequently, the correlation between two comparable tests implies something other 
than reliability. Our model, however, provides a basis for.estimating the reliabilities from the error 
variances of test scores. These reliabilities are also presented in Table 3-6. 

Examining the reliabilities, we find that tests exhibiting severe floor effects tend to have low 
reliabilities. For example, the estimates for the at-level pretest are as low as .31 and .46 for grade 1 in 
reading and math, respectively. Another low reliability is obtained for the at-level pretest for grade 4 
in math (.63). It is of interest to note that all three tests with low reliabilities are neither recom- 
mended by the publisher nor by SDC to be administered at the pretest time to the respective grades. 

In passing, we may also remark that based on our model, the correlation between the at-level and 
below-level test scores is equal to the geometric mean of their reliabilities. Referring to Table 1-8 of 
Report 9, the reader may verify this relationship between our reliability estimates and the projected 
population correlation between the test levels. This observation shows that the solution for the 
model as obtained with the unweighted sample data reproduces the same statistics (correlations) 
that have been projected to the population. Because only two tests a.e included in each achieve- 
ment factor, the correlation between them is practically identical to the observed value (i.e, the 
measurement model is a perfect fit). Thus, the observed correlations between the tests based on a 
selected sample that involves only cases with complete data for all variables employed are not 
discrepant from the population statistics. This is important as it partially supports our contention that 
data attrition is not a serious problem in the relational analyses of this, report. 

Finally, we should comment that the estimated correlations between the errors for the test scores 
are often noticeable. However, we shall not discuss them further (and we have omitted them from 
the presentation of the results) because they are incorporated into the model primarily to reflect the 
test situation and are not of special interest to us. 

Turning to the socio-cultural advantage factor, the inter-correlations among the home background 
variables are examined in terms of a common factor. The sign of the regression coefficient for the 
observed indicator on the common factor indicates tjie orientation of the factor-scale, while the 
magnitude shows the relative weight for the indicator (all these indicators are dichotomous and 
assume a similar scale). Additionally, the proportion of variance explainable by the common factor 
(the communality in the jargon of factor analysis) can be computed from the estimate variance for 
the unique factor and the observed variance for the indicator. The regression coefficients and com- 
munalities are also given in Table 3-6. The results for the reading and math analyses are similar, and 
the communalities are not large for ali three variables, reflecting their low-to-moderate correlations. 

Inspecting the regressions and communalities, we find that this common factor (SCAF) apparently, 
places a greater emphasis on the economic aspect of home background than on the other two 
aspects. The educational aspect is the least emphasized as evidenced by the smallest communality. 
This is largely a consequence of the higher correlation between Race/Ethnicity and participation in 
free or reduced-price meals than their correlations with mother's education. 

Because the observed indicators are discrete and their distributions are skewed (the projected pro- 
portion of whites, participants in free meals, and children whose mother graduated from high 




96 



.school are .77, .33, and .76 respectively. See Table 4-5 of Report 9 and Table 1-9 of Report 5), we 
expect some difficulties in fitting this part of the model. Indeed, inspection of the first-ord'er 
derivatives and the residual covariance-matrix upon convergence suggests some lack of fit here. In 
particular, the gradients and residual covariances tend to be substantial when mother's education is 
involved. This phenomenon may mean that mother's education has some distinctive relation w"^th 
other variables in the model that cannot be explained adequately by the postulated common factor. 

. Specifically,, we think that mother's education may have some direct relation with achievement in 
addition to that shared with other home-background variables, as studies often show that it is 
closely related to achievement — more so than the economic variables (see Report 4). We examin- 
ed this possibility by postulating a separate factor for mother's education itself. Other options that 
specify correlations between the unique factor for mother's education and the errors for test scores 
were also explored. These various modifications of the model did not result in sufficient improve- 
ment of fit to warrant the adoption of a different model. We then decided to maintain the original 
model for further examination of the role of mother's education in the achievement process. 

The Structural Relations in the Reading Achievement Process, For ease of presentation, we discuss 
the results of the reading and math analyses separately. Our major interest lies in examining the 
paths representing the influences of CE status on receipt of services and the effects of instructional 
services on achievement growth. For this purpose, the model examines five regression equations 
simultaneously. The first equation describes the direct relations of posttest achievement vith pretest 
achievement, CE status, the SCAF, and receipt of services. The other four describe the interrelations 
among the independent variables in the first equation so that their indirect effects on posttest 
* achievement are studied. 

The method of maximum likelihood estimation (see Appendix C2) is employed to obtain estimates 
for these regressions and the parameters in the measurement submodels simultaneously. The results 
for the structural regressions in the reading model are summarized in Table 3-7. The interrelation- 
ships among variables are exemplified in Figure CI -1 (see Appendix CD with the results for grade 4. 
T^e findings from this table are discussed below. ^ 

• The Relationship Between CE Status and Receipt of Instruction. As may be seen from the last 
three columns of this table, CE status has pronounced effects on the pattern of instructional 
services received. CE students received substantially more hours of instruction from special 
teaching staff and in small classes but fewer hours of instruction from regular classroom 
teachers. CE students also spend considerably less time working with tutors or independently 
in grades 2, 3, and 6, but the difference is not as large as that observed in the other two kinds 
of instruction. These findings reconfirm those reported in Technical Report 5. 

• The Effects of Instruction on Reading Achievement. The data in the second column show that 
special instruction, which is emphasized in CE services, generally has negligible, although 
positive, direct effects on posttest achievement after adjusting for differences in pretest 
achievement and background. The only kind of instruction showing noticeable and positive 
effects is regular instruction (in grades 1 and 5). Considering the total effects of the three 
kinds of instruction and the effects of CE status on receipt of these services together, we find 
little demonstrable effect of CE on achievement growth that is mediated by amounts of 
instruction., 

• The Role of Pretest Achievement in Determining the Posttest Achievement. The predominant 
determinant of posttest achievement is pretest achievement. This finding is reflected in the 
extremely high correlations between the two latent variables for achievement (often known 
as true-score correlations). For the benefit of those readers who see relations mostly in terms 
of correlation coefficients, we calculated the intercorrelations among the seven variables 
involved in the first regression equation and present them in Tabled -7 of Appendix CI - This 
table shows that the correlations between pretest and posttest range from .93 in grade 1 to 
.98 in grade 6. These correlations are substantially higher than those obtained with test 
scores on the recommended test level — notably a consequence of correction for 
unreliabilities. 
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Table 3-7 



Estimates of Regression Coefficients and Standard Errors 
(in parentheses) in the Path Model for Reading Achievement 



Predictor Variable!* 



Unstandardized Regression Coefficients and (Standard Errors) for Predicting 



Posttest 

(POST) 



Pretest 
XPRE) 



Hours of Instructional Services Received 



Regular 
<HR) 



Special 
(HS) 



Independent 
(HI) 



Pretestv (PRE) 1.44(.04)** 

CE status (CE) -1.44(.88) 
Socio-Cultural Advantage Factor (SCAF) -14.96(2.72) •• 
Instructional Services Received 

Regular > . (HR) .03(.004)** 

Special (HS) .02(.t>06) 

Tut or /Independent (HI) .02(.005) x 



-7.92(.72)** 
55.84(1. 76)«* 



-38. 0(2. 3)** 59. 8(1. 5)** 
5.4(4.7) -3.50(3.1) 



-10.6(1.6)* 
51.6(3.3)* 



Multiple R (R) 



.879 (.938) 



.356(.597) 



.029(.171) 



.14K.376) 



.055(.234) 



Pretest (PRE) 1.16 (.01)** 

CE Status (CE) 3. 20 (.64) 

Socio- Cultural Advantage Factor (SCAF) 5.84(1.60) 
Instructional Services Received 
Regular 1 (HR) .01 (.003) 

Special (HS) -.00(.005) 

Tutor/Independent (HI) - -.01 (.004) 



-22.32(.88)** 
68.96(2.08)* 



-19.3(2.1) •• 
5.5(4.3) 



57. 4(1. 4)** 
-.9(3.0) 



-20. 7(1. 4)** 
26.7(3.0) ** 



Multiple R (r) 



.965(.982) 



.3891.624) 



.OIK. 106) 



.15K.389) 



.046(.219) 



Pretest (PRE) .73(.01)** 

CE Status (CE) . -1.68(.56) 

Socio-Cultural Advantage Factor (SCAF) 8.32(1.28)** 
Instructional Services Received 

Regular (HR) -.00(.C02) 

Special (HS) i -.01 (.004) 

Tutor/Independent (HV .01 (.003) 



-30.72(1. 04)« 
93.36(2.40)* 



-19. 2(1. 9).** 
-14. 7(3. ^) 



60. 4(1. 3)** 
-8.1(2.4) 



-18. 3(1. 4)** 
6.3(2.5) 



Multiple R (R) 



.909 (.9 53) 



.475(.689) 



.010(.099) 



.220(.469) 



.025(.156) 



Pretst (PRE) .95(.01)** 

CE Status (CE) ° -2 .64 (.80) 

Socio -Cultural Advantage Factor (SCAF) 8.72(1.68)** 
Instructional Services Received 

Regular (HR) .01(.005) 

Special (HS) .0K.007) 

Tutor/Independent (HI) .01 (.006) 



-36.00(1.56) ** -19.9(1.8)** 
114. 64(3. 04)** -11.6(3.3) 



S6.4U.1)** 
-22.4(2.1) •• 



-3.3(1.2) 
.2(2,3) 



Multiple R (R) 



.917(.*58) 



.424 (.651) 



.013(.112) .269(.S19) .OOO(.^OO) 



Preteet (PRE) .95(.01)** 

CE Status (CE) -.72 (.64) 

Socio-CUltural Advantage Factor (SCAF) 7.92(1.44)** 
Instructional Services Received 

Regular (HR) .04(.005)** 

Special (HS) .03(.006) 

Tutor/Independent (HI) .01(.005) 



-38. 72(1. 36)* 
115.52(2.80)* 



-20.7(1.6) •• 
-25.9(2.t)** 



46.4(1.1) ** 
-23.6(1.8) ** 



-4.3(1.2) 
.3(2.0) 



Multiple R (R) 



.942(.971) 



.462(.6SO) 



.02K.147) 



.223(.472) 



.001 (.033) 





Preteet (PRE) 


.99(.01)*^ 








-7.6(1. 2)** 




CE Status (CE) 


1.60(.72) 


-37. 52(1. 6)** 


-15. 1(1. 6)** 


44. 6(1. 0)** 




Socio-CUltural Advantage Factor (SOF) 


5.60(1.52) 


128.08(3.04)** 


-13. 3(2. 5)** 


-24.9(1.6) ** 


-21. 0(1. 9)** 




6 Instructional Services Received 














Regular (HR) 


.0K.005) 












Special (HS) 


^01(.007) 












Tutor/Independent ( HI ) 


.02(.006) 












Multiple R 2 (R) 


•950(.975) 


.409 (.640) 


.008(.090) 


.218(.467) 


.014(.117) 



*Pratest *nd posttest achievement factors are latent variables, each having two indicators (at-level and below-level 
test scores) . Socio-Cultural Advantage Factor is derived frees three indicators (race/ethnicity, participation in 
free or reduced-price steals, and Mother's educational attainment) . Blank entries show absence of the path. 
•'Magnitude of z-ratio (estimate divided by standard errcr) exceeds 5. 
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The stropg correlations between pretest and posttest achievement inmcate not only the 
direct relation between them but alsotfie indirect relation between posttest achievement 
and other variables that are correlated with pretest achievement. As snown in the third 
column pf Table 3-7, both, the SCAF and CE status are important determinants of pretest 
achievement, and thus have substantial, indirect influences on pdsttest achievement W^ty 
Children from more advantaged backgrounds start with* higher achievement and maintain 7* 
their higher achievement status at the end of the school year. On the other hand, CE students 
achieve at lower levels both at the pretest and at the posttest, because they were low- 
achieving in the previous year. 

In view of the prominent role of earlier achievement in the determination of later achieve- 
ment, it is unlikely that other variables will demonstrate strong direct effects on achievement '* 
growth in a single school year. More fruitful research should examine the achievement pro- 
cess on a long-term basis, so that the accumulated effects of educational services, can be, 
noticed (see Report 15). - 

The Role of Compensatory Education in the Achievement Process. In general, CE status shows 
little additional influence on posttest achievement that is not mediated throu^i instruction. 
As explained earlier, a relationship between CE status and posttest achievement, indepen- 
dent of instructional services, would mean that CE status can effect other educational 
variables that are absent in the model but have influences on achievement growth. Thus, the 
/finding of little independent effect of CE status suggests a negligible net effect of other 
/characteristics <?f educational process that are CE-related but are not included in our mode]. 



* / The Influence of Student Background on Ach/evement. The socip-cultural advantage factor 
; (SCAR demonstrates considerable influence on achievement growth in reading. In this 
regard, the mo;st interesting phenomenon is that the effect of SCAF changes from negative in 
grade 1 to positive in other grades. j 

A plausible explanation for this reversal in relationships may be as follows. At the pretest in 
the first grade, children from advantaged homes achieve higher scores because of greater 
prior opportunity to learn the test material. In contrast, children from disadvantaged homes 
learn during the school year when they begin to receive fprmal instruction. Thus, at the post- 
test administration, the disadvantaged children will show'&greater growth. This explanation 
is appealing particularly because the tests employed in the two administrations cover similar 
skills (in fact, the aMevel pretest and the below-level posttest are identical). For 'these 
reasons, a negative relationship between the SCAF and achievement growth is obtained. 
However, this initial 'benefit' for the disadvantaged children dissipates soon'^fter 3 year of 
formal schooling. In later years, the relationship between SCAF and achievement growth 
returns to the normal expectation of greater growth for advantaged children. 

The Relationship Between Student Background and Receipt of Instruction, Our last remark on 
the data presented in Table 3-7 concerns'the effects of the SCAF on allocation 6f.services.Jn 
grades 3 through 6, thfc relatlpnship between SCAF and amount of special instruction is 
substantially negative, having controlled for the differences in CE status. Although not as pro- 
nounced, SCAF is also negatively related to amount of regular instruction in these grades. 
This result appears counter-intuitive because we normally think that children from advantag- 
ed homes are likely to attend schools that provide more intensive services. To understand 
this findma better, we offer a possible explanation on the basis of the relation between SCAF 
and achievement status. As explained in * p/eceding section, there may be a tendency to 
allocate services according to educational need within schools. Student's educational need is 
determined^based on his/her previous achievement, which has not been measured in this 
study, but is closely related to SCAF. As the direct influence of earlier achievement on receipt 
of services is not incorporated into the model due to lack of required data, it is reflected in 
the relationship between SCAF and the service variables. 
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The fact that only 19 to 25 percent of the students are selected to receive CE services in 
reading (see Table 3-1 of Report 9) suggest that schoojs may be inclined ,to provide more 
• instruction r* low-achieving students as an additional remedial action. Children from disad- 
vantaged homes are likely to have greater .educational need and thus tend to receive more 
instruction even if they are not formally selected to receive CE. 

The reader may recall that the correlation analysis presented earlier in this chapter also 
reveals some evidence for the practice of allocating services according to achievement 
status. This practice and the CE-selection policy together result in an inverse relationship be- 
tween receipt of services and achievement. The inverse relationship tends to mask the effects 
of services on achievement growth- As long as there are differential effects of services accord- 
ing to prior achievement, the linear model cannot adequately account for the differences. 
This problem is potentially responsible for our inability to find substantial effects of services 
on achievement growth. * **■ 

Finally, we note that the combined effects of CE status and the SGAF on receipt of services 
are generally small, as indicated by the multiple.correlations. Among the three kinds of. in- 
structional services, amount of special instruction has^he strongest relationship with CE 
status and SCAF. • ' ' • 

The Structural Relations in the Math Achievement Process. The results of the structural-relation 
analysis for math achievement are mostly similar to those obtained in reading. Estimates for the 
parameters in the five simultaneous regression equations are presented fci Table 3-8. The results for 
grade 4 are illustrated graphically in Figure C1-2 of AppendixC! . The correlations among the seven 
variables involved in these equations arc estimated with the model and presented in Table CI -7 of 
the same 'Appendix. The findings from Table 3-8 are discussed below., 

• The' Relationship Between CE Status and Receipt of Instruction. Looking at the regressions of 
the three service variables, the results sKow that CE students receive considerably more 
special instruction than non-CE students. But, at the same time, CE students also receive less 

, regular instruction. Combining all three kinds of instruction, the net effect is for CE students 
to receive more instruction in total in grades 3 through 6. The net effect of CE status on total 
amount of instruction received is negligible in* the lower two grades. As in reading, these 
findings reconfirm those obtained in Report 5. 

• The Effects of Instruction on MathAchievement. Examining the second column of Table 3-8, 
we find that amount of special instruction has positive, but insubstantial, direct effects on 
posttest achievement. The only exception is found in grade 3, where the estimate of this path 
coefficient is negligibly negative. By comparison, regular instruction has noticeable, positive 
effects on achievement growth in grades 2 through 5. Because CE services are characterized 
by receipt of more special instruction, this result suggests that amount of instruction is not 
likely a primary factor for explaining the effects of CE on achievement growth. 

An interesting observation toon the relationships between amount of instructional services 
and achievement growth is that all three kinds of instruction demonstrate sizeable effects in 
grade 4. We suspect that the introduction of more complex math concepts at this stage of 
schooling enhances the role of instruction in learning. 

• The Role of Pretest Achievement in Determining the Posttest Achievement. The relationship 
between pretest and posttest achievement is not as strong in math as in reading. However, 
pretest achievement remains the predominant factor in the determination of posttest 
achievement. Simple correlations between the two latent variables for achievement range 
from .87 in grade 1 to .93 in grade 5 (see Table CI -7 in Appendix CI). Again, the SCAF and CE 
status have considerable, indirect influences oh posttest achievement because of their rela- 
tionships with pretest achievement. 

The SCAF is positively ar<d substantially related to pretest achievement; but the relationship is 
j'\ less prominent in math than in reading. This observation conforms to the popular belief that 
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Table 3-8 



Estimates of Regression Coefficients and Standard Errors 
(in parentheses) in the Path Model for Math Achievement 



Predictor variables* 



Un standardized Regression Coefficients and (standard Errors) "for Predicting 



Posttest 
(POST) * 



Pretest 
(PRE) 



Hours of Instructional Services Received 



Regular 
(HR) 



Special 
(KS) 



Independent 
(HI) 



Pretest (PRE) 
CE status (CE) 

Socio-Cultural Advantage Factor (SCAF) 
. Instructional Service* Received 
Regular (HR) 
Speeial (KS) 
T^tor/Independent <HI) 



1.16(.02)** 
•08<.96> 
.40(1.92) 

.02(.006) 
.02(.012) 
.04(.008)** 



-2.24(1.04) 
55.60(1.84)** 



-19.2(1.4)** 26.6(.8>** -10.6(1.1)** 
-.9(2.2) -19.3(1.3)** , 12.0(1.7)** 



Multiple R (R) 



.765 (.875) 



.242 (.491) 



.018C134) 



.160 (.400) 



.022(.150) 



Pretest (PRE) 1.00 (.01)** 

ce status (ce) -i.2o(.ee) 

Socio-Cultural Advantage Factor (SCAF) 11.44(1.68)** 

Instructional services Received 
Regular (HR) .05(.006)*>* 

Special (HS) .Ol(.Oll) " 

Tutor/Independent (HI) -.02 (.009) 



-4.64(1.12) 
63.36(2.08)** 



-21.4(1.4)** 
-17.9(2.3)** 



22.4(.8)** , -1.9(1.0) 
-13. 2(1. 3)**-* 8.3(1.6)** 



Multiple R (R) 



.793 (.891) 



.229 (.478) 



.023(.152) 



.117(.342) 



.004 (.064) 



Pretest (PRE) .67 (.01)** 

CE Status (CE) t 1.20 (.64) 

^Socio-Cultural Advantage Factor (SCAF) 7.04(1.20)** 
Instructional services Received 

Regular (HR) \ 04 (.006)** 

Special (HS) -02(.009) 

Tutor/Independent (HI) « .03 (.006) 



-16.72(1.28)** 
72.00(2.24)** 



-15.2(1.3)** 32.6(.8)** 
-18.0(2.1)** -10.6(1.2)** 



-3.6(1.0) 
14.9(1.6)** 



Multiple R (R) 



.778 (.882) 



.283(.532) 



.017(.130) 



.19K.437) 



.019(.139) 



Prctesc (PRE) .80 (.01)** 

CE Status (CE) -6.88{.96>** 
Socio-Cultural Advantage Factor (SCAF) * 16.08(1.84) *^ 
Instructional Services Received 

s Regular (HR) .07(.009)** 

/ Special * (HS) .oe(.Oll)** 

Tutor/Independent (hD .06(.010)** 



-23.28(1.60)** 
98.72(2.96)** 



-14.6(1.4)** 
-11.3(2.2)** 



32.5(.9)** 
-16.4(1.5)** 



8.0(1.1)** 
10.2(1.8)** 



Multiple R <R) 



.£16 (.903) 



.265(.514) 



.010(.102) 



.15K.388) 



.008 (.092) 



Pretest (PRE) .77 (.01)** 

CE Status (CEK -.16{.80) 
Socio-Cultural Advantage Factor (SCAF) 6.88(1.44) 
Instructional services Received 

Regular > , (HR) .06(.006)** 

Special " (HS) .04 (.009) 

Tutor/Independent (HI) .04 (.008) 



-26.32(1.60)** 
96.48(2.64)** 



-17.1(1.6)** 32.3(1.0)** 
-8.8(2.2)** -18.7(1.4)** 



1.0(1.2) 
1.3(1.7) 



Multiplo R (R) 



.858(.927) 



.308(.555) 



.010(.102) 



-139(.373) 



.000 (.000) 



Pretest (PRE) * 1.02{.0l)** 

*CE Status (CE) 2.40(1.20) 

Socio-Cultural Advantage Factor (SCAF) 9.68(2.00) 
Instructional Services Received 

Regular (HR) .04(.0l0) 

Speci.U (HS) .03(.014) 

Tutor/Independent (HI) * .04(.0l2) 



-31.60(1.84)** 
103.36(3.04)** 



-28.1(1.6)** 
-2.9(2.3) 
5 



32.4(.8)** 
-16.7(1.2)** 



4.8(1.1) 
.0(1.7)' 



Multiplo R (R) 



.852(.923) 



.252(.502) 



.026(.162) 



.16K.401) 



.002 (.040) 



•Pretest and popttest achievement factors are latent variables* each having two indicators (at-level and below-level 
test scores). Socio-Cultural Advantage Factor is derived from three indicators (race/othnicity» participation in 
free or reduced-price weals* and ©other's educational attainment). Blank entries show absence of the path. 
••Magnitude of z-ratio (estimate divided by standard error) exceeds 5., 
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math skills are largely learned through schooling, while there are numerous occasions out- 
side the school where learning to read takes place. On the basis of this belief, the 
background factor is expected to be more strongly related to reading achievement than to 
math achievement. 

Independent of the background factor, CE status exhibits a negative relationship with pretest 
achievement, especially in grades 3 through 6. As in reading, this negative relationship is 
indicative of the low-achieving status of CE students before participation and the transmis- 
sion of earlier achievement to pretest achievement. 

• The Role of Compensatory Education in the Achievement Process. CE status does not exhibit 
much direct effect on posttest achievement except in grade 4. In this grade, the estimate of 
the regression coefficient for CE status is noticeably negative. As emphasized earlier in this 
chapter, CE status, being a dichotomous label for the students, can have meaningful effects 
on achievement growth only through its relationships with variables that differentiate CE and 
non-CE students. With this in mind, we think that the direct effect of CE status \ri grade 4 may 

" represent at least two sources: (1) the combined effecf of all aspects of educational ex- 
periences of CE students that are not correlated with amounts of instructional services receiv- 
ed; (2) the influence of background characteristics that are not subsumed under the SCAF 
but are different between CE and non-CE students. Therefore, unless there is further 
evidence, we should not draw a hasty conclusion that participation in CE has harmful effects 
ifi this grade. We suspect that the isolated incidence of a sizeable, negative coefficient for CE 
status could be just a finding by chance. 

• The Influence of Student Background on Achievement The direct effects of SCAF on posttest 
achievement are substantial and positive in all grades but grade 1; the effect in grade 1 is 
negligible. This finding is different from that in reading, where the effect of SCAF is 
significantly negative in grade 1. This difference may be explained by the differential oppor- 

4* tunity to learn reading and math skills outside the school. As opposed to reading, pre-school 
% learning in math skills is not prevalent. Therefore, the benefit of exposure to formal and struc- 
tured learning in math is erijoyed almost equally by children ojf all backgrounds. However, as 
the skills become more complex, the SCAF begins to show some positive relationship with 
learning. 1 

• The Relationship Between Student Background and Receipt of Instruction. The direct effects 
of SCAF on receipt of services are noticeably negative in both regular and special instruction, 
the latter in particular. This finding supports the contention that, disregarding CE status, there 
is also a practice of distributing more math services to students with greater need. Except for 
special instruction, the combined relationship of CE status and SCAF with receipt of services 
is weak. 

Conclusions from the Path-Model Analysis. The present analyses employing a general path-model 
provide only weak evidence for positive effects of instructional time on achievement. In particular, 
amount of special instruction, yvhich characterizes CE services, does not have appreciable effects on 
achievement growth. Therefore, we are not optimistic that provision of more special instruction 
alone will help close the achievement gap between CE students and their non-disadvantaged peers. 
To our disappointment, we find litWe evidence of success for the strategy of offering CE students 
more labor-intensive services in order to overcome their achievement deficit. Clearly, the fact that 
special instruction for CE students jexists is not enough to show the success of CE. We need to 
investigate further what takes place during the special instruction to know what elements of instruc- 
tion are beneficial to achievement. 

An Analysis-of-Covariance Model for Examining the Role of CE and Instruction in the 
Achievement Process 

In the preceding path analysis, the L1SREL model was applied to the entire sample and a dummy 
variable indicating CE status was employed to distinguish CE from non-CE students. With this 
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approach, the differences between CE and non-CE'students are examined in terms of the path coef- 
ficients for the CE-status variable. Because the majority of non-CE students achieve at a higher level 
and are expected to have a faster growth rate than CE students, it is inappropriate to compare their 
differences in posttest achievement directly to judge the effectiveness of CE. Although the initial dif- 
ferences between groups have been statistically adjusted by including the background and pretest- 
achievement variables in the model, the adjustments are often inadequate when the differences are 
large. For this reason, we were cautious not to interpret the coefficient for the dummy variable as a 
measure of the effect of CE. 

« 

Another difficulty in analyzing data from the total sample lies in the assessment of Jhe effects of 
instructional services on achievement growth. Because of the selection bias and^ tendency for 
schools to allocate services according to educational need regardless of CE status, amount of ser- 
.! vices received by the students is inversely related to their achievement level. As remarked earlier, 
this inverse relationship between achievement and service allocation tends to mask the effects of 
instructional services on achievement growth. 

To overcome these problems in the evaluation of the effects of CE and instructional services, further 
analysis will employ a restricted sample that excludes non-CE students who are judged as not 
needing CE. The non-CE students remaining in the sampje are more similar to the CE students with 
respect to achievement level and educational need (see Chapter 2). They are thus chosen to serve 
y, as comparison groups in many of our analyses. 

For the purpose of comparing the effects among different CE programs, CE students are divided into 
three groups accprding to the programs that serve them: Title I students in Title I schools, other-CE 
students in Title 1 schools, and other-CE students in other-CE schools. The comparison non-CE 
students are.divided into two groups depending on whether CE is provided in the schools they 
attend: needy non-CE students in CE schools and needy non-CE students in non-CE schools. This 
distinction is made in order to control for potential school differences in the comparison between 
CE and non-CE students. In total, there are five student groups involved in the present anatysis. 

A common approach to estimating group differences and effects of independent variables in this 
case isthe AN^OVA (analysis of covariance) design. Because measurement errors pose a serious 
DpbfeiTnin the ANCOVA (see discussions ^Chapter 2), SSrbom (1978) has proposed to perform 
^^ANCOVA with latent variables so as to solve the problem of measurement errors directly. Borrow- 
ing the-parlance in test theory, this analysis may be called 'true-score ANCOVA/ Essentially, a 
similar L1SREL model is applied to the groups in the design simultaneously. 

Description of the ANCOVA Model. The basic within-group model is depicted in Figure 3-4. The 
measurement models for the three latent variables with multiple indicators are identical to those 
specified in Figure 3-3 for the earlier path analysis. These three latent variables are: pretest achieve- 
ment, the socio-cultural advantage factor (SCAF), and ppsttest achievement. Pretest achievement, 
SCAF, and the three variables measuring instructional services comprise the independent variables 
(often known as covariates in ANCOVA) that determine the posttest achievement. Unlike the 
previous p^thanaJysijs, the direction of the interrelationships among the independent variables are 
not of particular concern here. Therefore, these relationships are examined simply in tjerms of inter- 
correlations. In this way, the analysis is focused on the estimation of the direct effects of amounts of 
instruction on achievement growth. 

The LISREL program ordinarily analyzes the covariance matrices and hence does not deal with 
means. However, in an ANCOVA situation, we are also interested in comparisons of differences in 
adjusted means (i.e., intercepts, when within-group regression surfaces are parallel) in order to 
assess the group (treatment) effects. For this purpose, a variable having a constant value of one is 
incorporated into the model so that the intercepts of the regression equations and the means of the 
latent variables can be estimated explicitly by analyzing the moment matrices. The constant' 
variable is not shown in the figure. Nevertheless, the complete model specified in the LISREL 
analysif actually includes direct paths from this 'constant' term to each of the five covariates and to 
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Pace/ 

Ethnicity. 



(Unique A 
Factor J ' 



Participation 




in free or 




reduced-price 




seals 





(Unique \ 
Factor J m 



Mother's 

educational 

attainment 
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(The model applies to data for grades 3 through 6* For grades 1 and 2, the two correlations, 
between measurement errors for test scores are replaced with a single correlation 
between the measurement errors for at-level pretest and below- level post test scores) 

Figure 3-4 

The WHJjin-Croup Model in the Analysis of Covariance for Reading *nd Math 
Achievement of CE Students and Non-CE Students Judged as Needing CE 




posttest achievement. The estimates of the coefficients for these hidden paths correspond to the 
group means for the covariates and the intercepts in the within-group regression equations, 
respectively. 

It is important to note that the moment matrix should be analyzed instead of the covariance matrix. 
The moment matrix contains means for the observed variables in the row corresponding to the 
'constant' variable. Hence, the mean differences among groups can be studied in the model. This 
option of LISREL absorbs the feature of COFAMM (SSrbom and Joreskog, 1976) that allows explicit 
estimates of factor means. Consequently, we can compare the means of the covariates among 
groups to describe their associations with CE status. 

The intercept (which is a function of the means and regression coefficients) can also be compared 
among groups to evaluate the direct affects of CE status that are independent of the effects of 
instructional services. 

The model described above serves as the basis for testing hypotheses on the effects of CE and the 
covariates on achievement growth. Mathematical formulations of this model are provided in 
Appendix C2. To facilitate later references, we designate this basic model as Model A. Two sets of 
constraints are then imposed on the basic model for testing the usual ANCOVA assumption of 
homogeneous within-group regressions. This assumption of parallel regressions is examined hierar- 
chically in two parts: for the pretest achievement and SCAF first, and then for the three service 
variables. Thus Model A is modified sequentially according to the two hypotheses to be tested to 
form Model B and Model C as follows: ^ 

• Model B imposes on Model A the constraints that the path coefficients from pretest achieve- 
ment and SCAF to posttest achievement are invariant over groups (for convenience, we refer 
to this set of constraints as Hb where H stands for hypothesis).* 

• Model C imposes on Model B the constraints (referenced as He) that the path coefficients 
from the three service variables to posttest achievement are invariant over groups. 

Thus, the validity of complete parallelism of the regressions can be assessed by the difference in the 
X?- statistic between Model C and Model A. 

Assuming the within-group regressions are parallel, we then fit another model (Model D) to the data 
in order to test the equality of adjusted group means: 

• Model D imposes on Model C the constraints (Hp) that the intercepts (i.e., the coefficients 
for the paths from the 'constant' variable to posttest achievement) are invariant over groups. 

In summary, four LISREL models (A-D) are fitted for the five analysis groups simultaneously. Our 
objective is to examine both the within-group and pooled path coefficients (estimated with 
Models A and C, respectively) for the service variabiles. These coefficients signify the direct effects of 
amount of instruction on achievement growth. This information and that about the differences in 
receipt of services among the groups are then considered jointly to evaluate the role of instructional 
services in effecting the achievement growth of CE students. 

In addition, the adjusted means for posttest achievement are compared among the groups in order 
to assess any remaining effects of CE on achievement growth, controlled for differences in 
background, prior achievement, and services received. 

Another use of the results is to compare the mean differences in pretest achievement and SCAF 
among the groups. Such comparisons provide us with information about the extent to which CE is 
targeted at the most disadvantaged children among the ones with some educational need. 

Fit of the ANCOVA Model and Test of Hypothesis. Though the sample is reduced in the present 
analyses by the exclusion of non-CE students not in need of CE, it is still quite large (ranging from 
around 3,200 to 4,500 for reading and math). Our interest is, again, not in the absolute fit of the 
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basic model per se. Nevertheless, the X2-statistics and the associated degrees of freedom afe 
presented in Table 3-9 as supplemental information. We follow the strategy adopted injable 3-5 
and calculate the fictitious NTs for Model A to be judged adequate at the .10 level. These values 
(obtained by assuming a proportional reduction of N in the five groups) are given in the table to help 
the readers assess the usefulness of the model. 

The reduced size for the total sample in general exceeds 1,000. Inspection of the discrepancies 
between the observed and estimated moments reveals no large values. On these bases, we consider 
the model reasonably satisfactory for our purpose. 

Regarding the appropriateness of the model, it should be noted that some difficulties were 
experienced in obtaining solutions with the LISREL program. Because the program fails to avoid 
parameter estimates beyond acceptable ranges, it sometimes converges to estimates that are inad- 
missible on conceptual grounds. For instance, negative estimates for the disturbance variances in 
the regression equations, and for error (unique) variances in the measurement models (commonly 
known as the Heywood case) were obtained in some analyses with the original Model A. Occa- 
sionally, estimates of correlated errors for the achievement variables were also found to be inad- 
missible '(with correlations exceeding 1.0 in magnitude). 

To overcome these problems, Model A was modified by constraining the troubled elements to be 
invariant over groups whenever inadmissible estimates were obtained. If the problem persisted with 
this action, we then tried other avenues such as constraining the problematic parameter to zero 
(i.3., removing the path; Jbreskog, 1969). With some effort, we eventually were able to arrive at a 
model in each case that resulted in proper estimates for all parameters. A summary of the required 
revisions for the original Model A is given in Table C1 -8 of Appendix C1 . These revisions were also 
incorporated into the corresponding Models B, C, and D. 

Additionally, Table 3-9 also presents the results of hypothesis testing on the assumption of parallel 
regressions and on the group differences in adjusted means for posttest achievement. There are tfo 
important violations of the assumption of parallel regressions with Jespect to the pretest achieve- 
ment and SCAF (see tests for He). On the other hand, within-group regressions of posttest achieve- 
ment on the services variables are often significantly non-parallel at the .01 level (see tests for He). 
For this reason, both the within-group and pooled estimates of these regression coefficients will be 
examined when we later discuss the effects of instructional services. 

However, in light of the large sample involved and the moderate group differences in covariate 
means (see Table«3-11), we proceed fo test the equality of adjusted posttest means by fitting 
Model D. As shown in the table, appreciable differences are found for grades 1 and 2 in reading, 
and for all grades but grade 2 in math. Such differences can be interpreted as CE effects, indepen- 
dent of instructional services. Further discussion of this result is postponed to a later part of this sec- 
tion where the adjusted means are examined explicitly. 



The Measurement of Achievement and the Soc/o-Cu/tura/ Advantage Factor. An important feature of 
the measurement model is that the regressions of the 6bser*<ecL variables on their respective latent 
variables are assumed identical for the five groups. This choice is forced upon us because, if the 
regressions are allowed to vary across groups, a conceptual difficulty arises. That is, changes in these 
regressions would mean that different metrics may be applied to measure the characteristics of 
these groups (Rock, Werts, and Flaugher, 1978). 

Table 3-10 summarizes the results of fitting the measurement submodels. As remarked earlier, the 
analysis of the moment matrix enables us to estimate the intercepts in the regressions of the 
observed indicators on the latent variables. In the identification conditions for the present model, 
we have set the means of the latent variables at zero for the group of Title I students. Consequently, 
these intercepts in effect become estimates of the means of the observed variables for this group. 
Looking at these intercepts, we find that, with few exceptions, the at-level and below-level tests dif- 
fer little in measuring mean group performance. 
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Table 3-9 



Goodness of Fit and Hypothesis Testing of the ANCOVA Model for Reading and Math 
Achievement of CE Students and Non-CE Students Judged as Needing CE 



Hypothesis Testing 

Measures of Significance 



Grade 1 Grade 2 Grade 3 Grade 4 Grade 5 Grade 6 



Goodness of Fit of Model A (Basic Model )t 

Chi- square (degrees of freedom) 

Range and (Total) of actual group 
sizes (N) y 

Reduction Factor of N to render x 2 for 



Model A insignificant at the 
level 



,10 



Range and (Total) of reduced group 
sizes 

Difference in x 2 (d.f.) for Hierarchical 
Testing of Hypothesis on tt : 

Hq - Znvariance of Regressions ojk-BOsT 
on PRE, and SCAF (Models ' 
versus Model A) 

<? 

H - Invar lance "of Regressions of POST 
^ on HR, HS, and HI (Model C 
versus Model B) 

H D - Equality of Adjusted Means of 
POST among groups (Model D 
versus Model C) 



974.5(146) 


662.6(146) 


669.6(141) 


505.9(137) 


481.6(137) 


565.3(141) 


324-1,710 
. (4,298) 


325-2,008 
(4,526) 


337-1,955 
(4,306) 


352-1,469 
(3,898) 


274-1,366 
(3,807) 


365-1,506 
(4,109) 


5.8 


3.9 


4.1 


3.2 


3.0 


3.5 


56-295 
(741) 


83-515 
(1,161) 


82-477 
(1,050) 


110-459 
(1,218) 


91-455 
(1,269) 


104-430 
(1*174) 


19.29(8) 


26.07(8) 


19.27(8) 


12.51(8) 


i 

3.19(6) 


19.49(6) 


27.66(12) 


• 50.26(12) 


• 6.40(12) 


26.99(12) 


* 15.51(12) 


20.14(12 


16.03(4)* 


25.32(4)* 


4.60(4) 


3.11(4) 


13,84(4) 


9.44(4) 



Goodness of Fit of Model A (Basic Model) t 





Chi -square (degrees of freedom) 


604.7(142) 


471.5(142) 


543.9(142) 


505.1(137) 


520.7(141) 


475.6(137) 




Range and (Total) of actual group 


234-1,046 


200-1,043 


284-1,092 


294-941 


279-1,063 


260-1,204 




sizes (N) 


(3,203) 


(3,217) 


(3,425) 


(3,255) 


(3,342) 


(3,598) 


M 


Reduction factor of H to render x 2 for 














A 


Model A insignificant at the .10 


3.7 


2.9 


3.3 


3.2 


3.2 


3.0 


T 


level 














H 


Range and (Total) of reduced group 


63-263 


69-360 


6.6-331 


92-294 


87-332 


93-401 




sizes 


'(666) 


(1,109) 


(1,038) 


(1,017) 


(1,044) 


(1,199) 



Difference in X 2 (d.f.) for Hierarchical 
Testing of Hypothesis on tt ; 

H - Invar lance of Regressions of POST 
on PRE, and SCAF (Model B 
versus Model A) 

H - Invar iance of Regressions of POST 
on HR, HS, and HI (Model C 
versus Model B) 

H - Equality of Adjusted Means of 
POST among groups (Model D 
versus Model C) 



15.30(8) 21.57(8)* 19.88(6) 



15.00(6) 



5.05(6) 



24.79(8)* 



55.24(12)* 17.00(12) 29.31(12)* 80.40(12)* 17.29(12) 27.26(12)* 



39.15(4)* 8.29(4 ) 53.06(4)** 30 . 60(4)* 21.34(4)* 17.98(4)* 



tPlease refer to the text for a description of the Model. The reduction factor for N to render x 2 for the model 
insignificant at the .10 level is obtained as the ratio of the observed x 2 to the critical value. If the data were 
generated from samples of the reduced sizes, the model would not be rejected at the .10 level. 
ttThree sets of restrictions (corresponding to H^, H , and H- respectively) were introduced to the basic model in 
hierarchical order to yield Models B, C, and D for testing the homogeneity of regressions and equality of adjusted 
means in the ANCOVA model* Each hypothesis is tested by comparing the two adjacent models differing only in the 
restrictions specified in the hypothesis. Abbreviations for the variables are: POST - latent variable for posttest 
achievement* PRE ■ latent variable for pretest achievement < SCAF ■ latent variable for the Socio -cultural advantage 
factor, HR ■ yearly hours of instruction received from regular teachers in groups of 7 or more; HS - yearly hours of 
instruction received from regular teacher in small groups (1-6) or from special teachers and aides* HI - yearly 
liours working with tutor or independently. 

•Indicates that the hypothesis is rejected at the .01 level on the basis of actual group sizes. The critical values for 
d.f. ■ 4, 8, and 12 are 13.28* 20.09* and 26.22, respectively. 
••Indicates that the hypothesis is rejected at the .01 level if the data were obtained with the reduced group sizes. 



ERIC 



107 



143 



4 



Table 3-10 

Regressions of Observed Indicators on Latent Variables in the ANCOVA Model for Reading 
and Math Achievement of CE Students and Non-CE Students Judged as Needing CE 

(From the Basic Model)t 





Latent 
Variable 


Postteit 


(POST) 


Pretest (PRE) 


Socio-cultural 
Advantage Factor (SCAF) 




Observed 
Xndicatorrt 


Below 
Level 


At- 
Level 


Below At- 
Level Level 


Race/ Free-Meals Mother's 
Ethnicity Participation Education 



1.00* 


.84 


1.00* 


.51 


1.00* 


-1.27 


.70 


1.00* 


* .81 


1.00* 


.97 


1.00* 


-1.28 


.67 


1.00* 


1.06 


1.00* 


.67 


1.C0* 


-1.25 


.61 


1.00* 


.90 


1.00* 


.74 


1.00* 


-1.34 


.61 


1.00* 


1.03 


1.00* 


.92 


1.00* 


-1.09 


.47 


1.00* 


.94 


1.00* 


.78 


1.00* 


-1.02 


.43 
















388.95 


384.15 


326.75 


33.6.55 


.47 


.64 


.56 


427.83 


428.27 


383.47 


381.91 


.50 


.61 


.60 


453.66 


451.90 


419.82 


418.82 


.4^ 


.63 


.57 


474.95 


474.31 


443.15 


448.51 


.51 


.62 


.55 


494.78 


494.42 


468.78 


468.10 


.47 


.64 


.55 


518.14 


518.94 


490.42 


494.46 


.42 


.66 


.54 



Regression Coefficients (Lambda)* 



Grade 
Grade 
Grade 
Grade 
Grade 
Grade 



Intercept (nu) * 



Grade 
Grade 
Grade 
Grade 
Grade 
Grade 



regression Coefficients (Lambda)* 



M 


Grade 1 


1.00* 


.85 


1.00* 


.64 


;ir00* 
IT. 00* 


-1.34 


.72 


A 


Grade 2 


l.qo* 

1.00* 


.86 


1.00* 


.94 


-1.19 


.61 


T 


Grade 3 


1.25 


1.00* 


.82 


1.00* 


-1.08 


.47 


\ H 


Grade 4 


1.D0* 


1.00 


1.00* 


.71 


1.00* 


-1.47 


.64 


Grade 5 


1.00* 


1.15 


1.00* 


.89 


1.00* 


-1.14 


.46 


A 


Grade 6 


1.00* 


1.07 


1.00* 


.81 


1.00* 


-1.11 


.42 



Intercept (nu) * 



s 


Grade 1 


373.02 


372.78 


311.74 


317.38 


.34 


.77 


.48 


I 


Grade 2 


420.48 


418.32 


367.80 


370.12 


.39 


.72 


.54 


s 


Grade 3 


463.69 


472.37 


411.65 


406.65 


.36 


.73 


.53 




Grade 4 


504.10 


503.54 


450.50 


456.54 


.47 


.67 


.55 




Grade 5 


531.97 


538.21 


490.93 


490.85 


.42 


.69 


.54 




Grade 6 


569.49 


573.69 


524.89 


525.13 


.41 


.69 


.54 



The estimates of the regressions are obtained with the basic Model (Model A) . The results with the other throe 
•odel 6 are similar. Please refer to the text for explanations of the Model. 

**Each of the two latent variables for achievement has two indicators vertical scale scores on two adjacent levels 
of CTBS (below-level and at-luvol, see Table 1-2 of Technical Report 9 for test levels administered). The socio- 
cultural advantage factor has three indicators. For coding of these indicators, see Table 3-6. 
*Pixed parameters in the model for the purpose of defining the scales of the latent variables. 

^Regressions of observed indicators on latent variables are nssuced to be invariant over the analysis groups. 
Because of the identification conditions imposed on the model, the intercepts are in effect estimates of means 
for Title J students in Title I schools. 
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The intercepts for the three home-background variables provide the estimates of proportions of 
Title I students who are White, who participate in meal programs, and whose mothers graduated 
from Jygh school, respectively. Comparing these proportions with the projected population values 
(.77/ .33, and .76, respectively; see Reports 5 and 9), we find that Title I programs serve dispropor- 
tionately high percentages of minorities, participants in meal programs, and children whose 
mothers did not graduate from high school. The differences are very substantial, especially with 
respect to participation in free or reduced-price meal programs (the proportion for Title I students is 
sometimes more than twice that in the general population). 

Examination of the regression coefficients (lambda) of the test scores on the achievement factor 
reveals a slightly different picture from that in the analysis for the entire sample (see Table 3-6). The 
present data more frequently reflect test-floor effects than ceiling effects, as might be expected for 
low-achieving students. This phenomenon is especially noticeable at the pretest administration. 
With few exceptions, estimates of lambda for the at-level pretests are substantially lower than 1.0, 
the value assumed if the two test levels are equivalent. As noted previously, such results are normal- 
ly obtained when the at-level test is too difficult. 

To study further the effects of test level, we computed the within-group reliabilities for each test 
level at the pretest administration. These reliabilities are shown in Table C1-9 of Appendix C1, 
where it may be seen that for grade 1 , the reliabilities of the at-level tests are extremely low in both 
reading and math for all groups. In general, the reliabilities for the at-level tests are lower than those 
for the corresponding below-level tests. Most important, the reliabilities are appreciably lower for 
. those students whose achievement levels are at the low end of the distribution than for the general 
population (see Table 3-6). These observations confirm the concern of functional-level testing. The 
selection of a better test level, based on the score distribution within each grade and each school, to 
furnish the scores for our analyses proves to be an important improvement of this study over the 
evaluation studies. This practice alleviates the potential test-floor effects on t\\e performance of the 

disadvantagecLstudents and thereby increases the validity of the evaluation. 

** 

The factor patterns for the background variables are similar to those obtained in Table 3-6. The 
SCAF represents primarily the economic and cultural aspects of socio-background. As in the path 
analysis, information from the technical outputs of the LISREL program (e.g., the first-order 
derivatives and residual moments) suggests a slight inadequacy of the piodel in examining the 
effects of mother's education in terms of the common background factor. Again, attempts to 
improve this situation did not have much payoff. Therefore, we adopted the model without further 
modifications. 

Results of the Analysis Based on theANCOVA Mode/. The results of fitting the ANCOVA model are 
discussed in three ways: mean group differences with respect to the independent variables, within- 
group and pooled estimates of the path coefficients, and group differences in adjusted means for 
posttest achievement. 

(1) Estimated Means of the Covariates 

For convenience, the metrics of the covariates are defined by setting the origins at the 
respective means for Title I students. The scales for the latent variables in the model are 
selected to be the same as one of their respective indicators. Specifically, the achievement 
factors are measured in terms of the scale of the below-level tests, while the SCAF assumes a 
scale between 0 and 1 (as for Race/Ethnicity). Thus, means for the achievement factors are 
expressed in VSS units, whereas means for SCAF have the meaning of proportions. For 
instructional services, the observed variables (expressed as deviations from the means for 
Title I students) are entered directly into the analysis as covariates. 

Means for the five covariates are presented in Table 3-1 1 by groups. The reader is reminded 
that the means for Title I students are always zero by virtue of the metrics chosen in the 
analysis. The pattern of group differences with respect to the covariates are similar between 
reading and math. 

Us 
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Table 3-11 

Croup Differences in Means for Covariates Employed in the ANCOVA 
With Latent Variables for Reading and Math Achievement 



Estimated Means for Covariates Estimated Means for Covariates 



Grade 
• 


Student 
Group** 




in Readina Analysis* 






in Math Analysis* 




PRE 


SCAF 


HR 


KS 


HI 


PRE 


SCAF 


KR 


HS 


HI 




TI/TI 


0.00 


.00 


0.0 


0.0 


0.0 


0.00 


. 00 


0 ■ 0 


0.0 c 


t 0.0 




OCE/TI 


11 . 12 


.13 


11.5 


-27.4 


-1.1 


17.52 


.23 


-4.4 


-27.0 


. i 


1 


OCE/OCE 


7.24 


.20 


-30.0 


-8.9 


3.5 


10.44 


.23 


-9.1 


-12.0. 


12.1 




NNCE/CE 


-2.96 


.12 


16.7 


-46.6 


7.5 


-7.64 


.14 


7.6 


-32.3 


8.8 




NNCE/NCE 


-7.28 


.'11 


46.4 


-61.7 


9.3 


-3.16 


.23 


18.3 


-31.6 


11.8 




TI/TI 


0.00 


.00 


0.0 


0.0 


0.0 


0.00 


. 00 


u . u 


0. Oi} 


0.0 




OCE/TI 


24.52 


.14 


10. 5 


-31.5 


4.0 


2 1 , 52 


.17 


-11.3 


-16.7 


3 .4 


2 


OCE/OCE 


7.48 


.19 


-22.2 


-11.4 


22.7 


15.40 


.19 


-7.5 


-.9 


6.3 




NNCE/CE 


2.64 


.08 


9.9 


-44.9 


22.2 


-4.04 


.13 


16.7 


-18.3 


5.0 




NNCE/NCE 


-1.88 


.11 


11.7 


-65.3 


10.9 


-11.12 


.17 


19.6 


-31.5 


' -7.1 




TI/TI 


0.00 


.00 


0.0 


0.0 


0.0 ■ 


0.00 


. 00 


0.0 


0.0 


0.0 




OCE/TI 


22. 24 


.03 


1.6 


-23.5 


xu . o 


IT 

1 / . 71 


.15 


9.3 


-19.0 


2 . 5 


3 


OCE/OCE 


9.44 


.18 


-12.1 


-2.1 


2.9 


16.44 


.26 


9.7 


.-14.1 


20.5 




NNCE/CE 


7.28 


.09 


1.6 


-42.3 


17.9 


-3.60 


.14 


7.5 


-30.5 


4.7 




NNCE/NCE 


-1.04 


.08 


33.2 


-56.4 

* 


12.6 


-4.12 


.20 


21.4 


-42.1 


10.8 




TI/TI 


0.00 


.00 


0.0 


O.Q 


0.0 


0.00 


. 00 


f\ n 
u.u 


0.0 


0.0 




OCE/TI 


20 • 56 


.08 


-11.3 


-14.9 


1.9 


24 .32 


.08 


-3.4 


-13.1 


14.8 


4 


" OCE/OCE 


18.96 


.10 


-13.4 


-20.2 


10.3 


20.12 


.10 


-15.8 


-12.5 


19.5 




NNCE/CE 


10.08 


.08 


7.3 


-49.5 


5.9 


-.36 


.07 


6.1 


-30.6 


-4.3 




NNCE/NCE 


5.40 


.09 


24.6 


-60.5 


-13.1 


.20 


.08 


16.5 


-43.3 


-1.8 




TI/TI 


0.00 


.00 


0.0 


0.0 


0.0 


otoo 


.00 


0.0 . 


0.0 


0.0 




OCE/TI 


20.84 


.07 


-7.1 


-18.0 


11.3 


27.12 


.09 


-1.1 


-30.9 


12.5 


5 


OCE/OCE 


10.16 


.11 


-.7 


-14.5 


8.8 


7.28" 


.10 


-22.0 


-22.1 


16.3 




NNCE/CE 


13.40 


.02 


11.4 


-44.9 


9.7 


3.68 


.02 


9.9 


-40.8 


9.1 




NNCE/NCE 


-3.44 


.il 


19 6 


-49.5 


-4.7 


-4.64 


.15 


5.1 


-43.1 


1.4 




TI/TI 


0.00 


.00 


0.0 


0.0 


0.0 


0.00 


.00 


0.0 


0.0 


0.0 




OCE/TI 


35.28 


.21 


4.2 


-22.8 


-13.1 


26.52 


.20 


-15.0 


-29.1 


11.6 


6 


OCE/OCE 


8.28 


.15 


-i0.5 


-17.6 


5.8 


2.04 


.11 


-14.1 


-18.5 


16.2 




NNCE/CE 


20.12 


.20 


1.1 


-43.2 


-.9 


R.24 


.12 


13.8 


-44.4 


2.0 




NNCE/NCE 


8.64 


.IP 


'19.1 


-48.9 


3.1 


-1.04 


.21 


20.7 


-38.0 


-.5 



Estimates are obtained with the basic Model (Model A) . Models B and C provide practically identical 
estimates. Because the models set means for the group TI/TI at zero, the table entries in effect show 
group means deviated from those for "TI/TI* group. The abbreviations for variable names are: PRE - 
latent variable for pretest achievement; SCAF - socio-cultural advantage factor; Kk » hours of regular 
instruction per year* HS - hours of special instruction per yean and HI * hours of tuto., independent 
work per year. 

## ~ Title I students in Title I schools; OCE/TI * other-CE students in Title I schools; OCE/OCE - > 
: students in other-CE schools; NNCE/CE * non-CE ^students in CE schools who are judged as needing 
NNCE/NCE - non-CE students in non-CE schools whp are judged as needing CE. 




The data shfcw that the pretest performance of Title I students is generally comparable to that 
. of the comparison non-CE students. However, other-CE students e particularly those anen 
ding Title I schools, on the average, achieve at a slightly higher level than the other three 
groups. This is expected because most Title I services are directed to low-achieving students 
while the purposes of other CE programs are less clear. For the SCAF, the four groups of non- 
Title I students always hav6 higher mea,, <han the Title I students, an indication that Title I 
programs indeed serve the" most disadvantaged children. 

The means for the service variables clearly show that/despite their judged need for CE, the 
comparison non-CE students receive considerably less special instruction but more regular 
instruction than the Title I students. Differences among groups of non-Title I students a> # e less 
substantial. These data confirm the practice of providing special instruction primaril/ to CE 
students, particularly Title I students. Group differences in the amount of time spent working 
independently or with tutors are not as pronounced as those in regular and special instruc- 
tion. 

(2) Within-Croup and Pooled Effects of the^Covariates 

Table 3-12 presents the within-group (as obtained with Model A) and pooled (as obtained 
with Model Q regression coefficients for the five covariates. In both reading and math, the 
Ndata consistently show that pretest achievement is a prominent determinant for posttest 
achievement. In contrast, independent effects of amounts of instruction are found to be 
appreciable only sporadically. These effects frequently vary with groups, as indicated by the 
heterogeneous within-group coefficients for grades 1, 2, and 4 in reading and for grades 1,3, 
4, and\£ in math (see Test He in Table 3-9). The pooled effects are similar to those obtained 
with ordinary regression analyses (see Table 3-2) that employ the same background variables 
but only t^st scores for the recommende-j level. 

Examining tiie data in Table 3-1 2, the effects of instructional services may be summarized for 
reading and math separately as follows: 

• In reading, both the within and pooled coefficients for the service variables are mostly 
insubstantial for grades 2 through 4. Thus, the heterogeneous within-group regressions 
for grades 2 and 4 do not have practical implications and may be regarded simply as 
statistical artifacts. For grades 1, 5, and 6, appreciable independent effects of amount of 
regular instruction are noted consistently within the group of Title I students, but only 
occasionally within other groups. Because Title I students constitute a large group in the 
analyses, the pooled effects of regular instruction are also appreciable in these grades. 
The effects of amounts of special instruction and work with tutor or independently are 
generally negligible. The nonparallel within-group regressions :n grade 1 largely reflect 
the lack of effects within the two groups of other-CE students. 

• In math, amount of regular instruction consistently shows noticeable effects within the 
groups of Title I students in grades 2 through 5. In terms of the pooled effects, regular 
instruction demonstrates noticeable effects in all grades but grade 1. The data also show 
some appreciable effects of special instruction within the group of Title I students and for 
all groups combined in grades 4 and 5. In grade 1, where nonparallel regressions are evi- 
dent, amount of special instruction has some small negative effects within the group of 
Title I students, but shows positive effects within the two groups of other-CE students. 
These differences among groups are reversed in grade 4, where the heterogeneity 
reflects that special instruction is helpful for Title I students but not for other-CE students. 
One possible explanation for such results might be the changes in curriculum to involve 
more complex concepts at grade 4. Effects of the amount of special instruction are 
seldom noticeable for the groups of comparison non-CE students, possibly because they 
don't receive much special instruction. The effects of tutor/independent work are found 
substantial primarily for the groups of comparison non-CE students in grades 4 and' 6. 



Table 3-12 



WKhin-Group and Pooled Regression Coefficients in the ANCOVA 
Model With Latent Variables for Reading and Math Achievement 
of CE Students and Non-CE Students Judged as Needing Cgt 

Reading Analysis - Regression of Hath Analysis - Regression of 

Student r^mtt+at krkUvMMnf on+ PCJttCSt Achievement Otlt _ 





Groupt 




















KI 




PRE 


SCAF 


HR 


HS 


HI 


PRE 


SCAF 


HR 


HS 




TI/TI i 


1.374** 


-14.56* 


.041* 


.018 


.014 


.948** 


-3.84 


.010 * 


.^.083* 


.039 




OCE/TI 


1.556** 


-8.24 


-.007 


.004 


.006 


1.008** 


2.56 


.015 


'.224* 


.221* 


1 


OCE/.OCE 


1.294** • 


-8.72 


-.028 


-.023 


-.042 


1.430** 


-10.48 


.259* 


.438* 


.213 




NNCE/CE 


1.246** 


-11.36 


.028* 


-.oop 


.002 


1.024** 


.08 


.046 


.002 


-.014 




NNCE/NCE 


.927** 


24.80 


.105** 


.108* 


.054 


1.126** 


20.72 


.024 


.dl9 


.066 * 




Pooled 


1.444** 


-14.32* 


* .026* 


.013 


.013 


.987** 


1.84 


.028 


.004 


.043 




TI/TI 


1.248** 


-4.80 


-.013 


-.010 


-.030 


1.144** 


.48 


.083* 


-.018 


-.054 




OCE/TI 


1.119** 


17.20* 


-.018 


.018 


.052 


.957** 


28.72* 


.075 


.017 


.037 


2 


OCE/OCE 


1.337** 


8. If 


.020 


.042 


-.029, 


1.148** 


23.68 


.062 


.022 


.014 




NNCE/CE 


1.246** 


9.76 


.058* 


.014 


-.005 


1.063** 


4.88 


.039 


.034 


.002 




NNCE/NCE 


1.123** 


6.88 


.037 


-.066 


.007 


1.122** 


6.08 


.104* 


-.034 


-.020 




Pooled 


1.196** 


4.32 


.012 


-.001 


-.014 


1.067** 


9.12* 


.070** 


-.002 


-.014 




TI/TI 


.821** 


7.12* 


.008 


.006 


.017 


.932** 


1.76 


.066* 


.022 


-.009 




OCE/TI 


.787** 


9.7(» 


.020 


.016 


-.004 


.786** 


4.92 


.072 


.018 


.147* 


3' 


OCE/OCE 


.869** 


1.60 


.006 


.006 


-.012 < 


.827** 


8.72 


-.026 


-.134* 


-.048 • 




NNCE/CE 


. 750** 


8.64 


-.006 


-.002 


.009 


.777** 


9.28 


.058 


.014 


.026 




NNCE/NCE 


.613** 


27.04* 


.018 


-.024 


-.066 


.702** 


12.32* 


-.005 


-.111 


-.018 




Pooled 


.805** 


7.36* 


.005 


.004 


.007 


.810** 


8.00* 


.034* 


r.016 


.014 




TI/TI 


.883** 


9.60 


.018 


.022 


.014 


.925** 


14.1c 


.067* 


.191" 


.029 




OCE/TI * 




12.16 


.005 


.022 


.036 


.804** 


30.80* 


.022 


-.102* 


.097 


4 


OCE/OCE 


.964** 


10.80 


-.026 , 


.043 


.038 


.863** 


15.84 


-.210* 


-.038 


-.063 




NNCE/CE 


.896** 


13.92* 


-.007 . 


-.019 


.038 


.897** 


-2.40 


.058 


.117* 


.141* 




NNCE/NCE 


.893** 


29.92 


.099* 


,018 


-.040 


.879** 


15.36 


.170* 


.037 


.143* 




Pooled 


.945** 


10.96* 


.010 


.016 


.027* 


.913** 


10.48* 


.065* 


.090** 


.067* 




TI/TI 


.974** 


6.16 


.038* 


.039* 


.021 


.903** 


5.36 


.075* 


.078* 


.017 




OCE/TI 


1.007** 


5.68 


.049 


.026 


-.010 


.873** 


3.84 


.027 


.024 


.046 


5 


OCE/OCE 


.960** 


1.68 


-.040 


.010 


.035 


.921** 


5.60 


-.033 


.005 


-.072 




NNCE/CE 


.995** 


6.88 


.042* 


.034 


.009 


.864** 


.48 


.041 


.045 


.042 




NNCE/NCE 


.990** 


8.24 


.060 


.002 


.069 


.843** 


1.92 


.042 


-.077 


.043 




Pooled 


.997** 


4.56 


.032* 


.032* 


.014 


.876** 


3.12 


.054* 


.039* 


.035 




TI/TI 


.952** 


1.44 


.046* 


.024 


.056* 


.995** 


-13.44 


.038 


.022 


-.062 




OCE/TI 


1.000* • 


9.36 


.025 


.030 


.036 


.948** 


11.68 


.142* 


.072 


. .115 


6 


OCE/OCE 


.873** 


1.52 


-.036 


-.078 


.053 


1.204** 


7.60 


-.110 


.098 


..099 




NNCE/CE 


.915** 


9.52 


.013 


.015 


.005 


.883** 


6.08 


.045 


.030 


.099 




NNCE/NCE 


.903** 


39.52 


.130* 


.086 


.116 


.995** ' 


13.52 


.084 


.037 


.155* 




Pooled 


.966** 


4.40 


.029* 


.014 


.029 


.954** 


4.80 


.053* 


.038 


.073* 



/ 

/' 



Within group regressions are obtained with Model- A; pooled regressions are obtained with Model C. Please 
refer to the text for descriptions of the Models. The abbreviations for variables and student groups are 
explained in Table 3.-11. 

*s - ratio (estimate divided by standard error) exceeds 2.5. 
**x - ratio (estimate dividod by standard error) exceeds i».0. 
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< It should be noted that the results summarized a above generally indicate only modest, 
although noticeable, effects of amounts of instruction on the achievement of disadvantaged 
students. These findings suggest that the differences in receipt of services between the CE 
and comparison non-CE students (see Table 3-1 1) are not likely to be the primary factors that 
lead t<^ positive CE effects. 

The socio-background factors (SCAF) show some noticeable effects on achievement growth, 
independent of pretest achievement and services. Positive effects are observed in grades 3 
and 4 for both reading and math, and also in grade 2 for math. \p contrast, the SCAF 
demonstrates some negative relationships with achievement growth in grade 1 for reading. 
This finding is similar to that in the previous path analysis and may be explained similarly by 
the different experiences in preschool learning among students from different backgrounds. 

* 

(3) Differences in Adjusted Croup Means for Posttest Achievement 

The data in Table 3-9 indicate some moderate evidence for violation of the assumption^ 
parallel regressions, particularly with respect to service variables, for grade 2 in reading and 
for grades 1 and 4 in math. (The other significances noted in that table are very marginal con- 
sidering the large sample size in the analyses.) The preceding examination of the effects of 
'instructional time suggests that the untenability of this assumption may have practical 
implications in th:* comparisons of adjusted group means only for grades 1 and 4 in math. 
Strictly speaking, only conditional comparisons of adjusted posttest means are appropriate in 
these two cases. In all other cases, comparisons of adjusted posttest means are not affected 
by the level of instructional services. 

The intercepts, estimated with Model B (which allows heterogeneous regression for the 
instructional variables) represent the conditional posttest means for the groups with amounts 
of instruction set equal fo the means for Title I students. Therefore, comparison of these 
intercepts provides a basis for evaluating the effects of CE, conditional on instructional ser-/ 
vices. When the within-group regressions are parallel, comparisons in terns of the adjusted 
posttest means estimated with Model C are appropriate. However, in all of our analyses, the 
intercepts obtained with Models ,B and C show similar differences* among the groups. We 
thus present only the adjusted means as obtained with Mode! C in Table 3-13, for the puN 
pose of assessing the group (CE) effects. All adjusted means are expressed as deviations fronri 
the means for Title I students. For additional reference, the unadjusted means (estimated fao® 
tor means for posttest achievement) are alsoj?resented in the table. ' 

In reading, noticeable differences among groups are observed for grades 1 and 2. In both 
cases, Title I students exhibit the highest adjusted means. As the effects of,instructional time 
have been controlled, these findings imply that some other CE-related variables must be 
responsible for the positive effects of Title \ programs. For other grades, the differences are 
negligible, suggesting that after adjusting for differences in instructional time and 
background, there are no independent effects of CE. 

Earlier, we found that positive pooled -effects of amounts of instruction on achievement 
growth were demonstrable only in grades 1, 5, and 6 for regular instruction and in grade 5 for 
special- instruction. Considering the lesser amount of regular instruction received by CE 
, students, Title I students in particular, in exchange for more special instruction, we conclude 
» from these results that there is little evidence that the achievement growth of CE students is 
accelerated by way of the amounts and kinds of instruction they receive. The current 
analyses cannot support the contention that a reduction of the anticipated achievement gap 
between CE 4 students and their non-disadvantaged peers will result from merely increasing 
the amount of special instruction. Thus, where there are observed benefits of CE to achieve- 
ment of its participants, we need to continue.the search for an explanation of how it works. 

Turning to the results for math, the groups differ in adjusted means appreciably in all grades 
but grade 2. Again, Title I students always show the highest adjusted means. The results thus 



. table 3-13 

Croup Differences in Unadjusted and Adjusted Means for the 
Latent Posttest Variable Assuming Homogeneous Regressionst 



Reading Groupstt 



Math Groupstt 



Grade 



Mean 



PI/TI 4 OCE/TI OCS/OCE KNCE/CE nnce/nce 



TI/TI OCE/TI OCE/OCE NNCE/CE NNCE/NCE 



Unadjusted 


J0.OO 




1.28 


-8.28 


-16.56 


- 0.00 


13.28 


8.88 


-15.84 


-13.84 


Adjusted i 


¥ 0.00* 


•6.12* 


-5.00* 


-2.12* 


'r-5.20* 


0.00* 


-4.28* 


-2.72* 


-8.96* 


-12.00* 


Unadjusted 


0.00 


23.34 


9.24 


.96 


-6.28 


0.00 


22.16 


17.64 


-5.96 


-13.00 


Adjusted 


0.00* 


-6.80* 


-.00* 


-2.36* 


-4.56* 


0.00 


-1.60 


.00 


-4.00 


-4*24 


Unadjusted 


0.00 


16.12 


8.68 


5.52 


-2.92 


0.00 


9.96 


5.84 


-9.96 


-9.80 1 


Adjusted 


p. 00 


-2.12" 


-.28 


-.92 


-2.40 


0.00* 


-6.40* 


-10.36* 


-8.96*. 


-9.64* 


Unadjusted 


0.00 


19.40 


16.04 


9.92 


5.40 


0.00 


20.72 


5.52 


-3C06 


-6.32 


Adjusted 


, 0.00 


-.52 


-2.80- 


.08 


.36 


0.00* 


-2.28* 


-13.28* 


-.76* 


-4.4d* r ' 

* • 


Unadjusted 


,0.00 


18.40 


15.44 


13.08 


-3.72 


0.00 


15.28 


3.80 


-1.20 


-9.52 


Adjusted 


0.00 


-2.08 


5.08 


.56 


.20 


0.00* 


-7.96* 


-1.36* 


-3.68* 


*-4.52* 


Unadjusted 


0.00 


'2.28 


3.12 


16.68 


5.52 


0.00 


18.48 


^-5.4*} 


. -.92 


-7.72 


Adjusted 


0.00 


-2.16 


-5.08 


-3.04 


-3*44 


0.00* 


-6.72* 


^-7.80* 


-8.56* 


*7.40* 



The adjusted meai^s are based on the regressions of posttest on pretest/ socio-cultural advantage factor/ and 
i amounts of instruction received in three settings (regular, special/ tutor/independent} / assuming homogeneous 
i wi thin-group regressions. Both the adjusted and unadjusted means are expressed as deviations f£°m the 
' corresponding means for the TI/TI group. \ % 

**The analysis groups are: TI/TI ■ Title I students in Title I schools; OCE/TI « Other-CE otudents in Title I 

schools; OCE/OCE = Other-CE students in Other-CE schools; NNCE/CE = Non-CE students in CE schools who are 
i judged as needing CE*; NNCE/NCE =» Non-CE students in Non-CE schools who are judged as needing CE. 

^Differences in adjusted means among the five groups are significant at the .01 level. 

/ . 
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provide some evidence that CE, specifically Title I programs, has positive effects on achieve- 
ment growth, but the effects are independent of that of amounts of instruction. Except for 
Title I students in grades 4 and 5, special instruction does not show positive effects or 
achievement. By comparison, there is more evidence for positive effects of regular instruc- 
tion. On the basis of these results, there is rfo reason for us to believe that the amounts and 
kinds of instruction received by CE students play dominant roles in explaining their achieve- 
ment growth. 

Conclusions from the ANCOVA. We now recapitulate the results of the ANCOVA with an emphasis 
on the role of instructional services in effecting the achievement growth of disadvantaged students. 
In l^oth reading and math, CE students, specifically Title I participants, generally achieve at a com- 
. parable level at the pretest as that of the non-C£ students judged to have need for CE. Title I students 
come from families with slightly more disadvantaged backgrounds than those of other CE students 
and comparison non-CE students. CE students tend to receive more special instruction but less 
regular instruction than needy non-CE students. The net differences in total instructional services 
indicate that Title I students receive more services than the other groups. However, judging from 
the scant evidence for positive effects of special instruction, the results do not support the expecta- 
tion that provision of more intensive instruction to CE students will help reduce the achievement 
gap between them and the non-disadvantaged students. These remarks agree well with our conclu- 
sions based or. ordinary regression analyses. 

SUMMARY AND CONCLUSIONS 

Theeffec .of the amount of instruction received on achievement are studied with three approaches 
in order to understand how CE works. Assuming that the fan-spread hypothesis is valid, a simple 
' treatment-effect correlational method is used to detect the effects of instruction. Overall, the 
negative correlations between achievement and amount of instruction received during the school 
- year tend to decrease slightly from pretest to posttest, ind Seating a support for positive effects of total 
■ instructional time. 

In order to determine the effects of different kinds of instruction, the total instruction is divided into 
amounts of regular instruction, special instruction (which characterizes the services received by CE 
students), and tutor/independent work. Multiple-regression and structural-relation models are then 
. employed to determine the effects of these three kinds of instruction. For both reading and math, 
these analyses show that there are small but positive effects of regular instruction, while amount of 
special instruction seldom demonstrates noticeable, positive effects. Furthermore, only small pro- 
portions of the variation of posttest achievement are attributable to the combined effects of instruc- 
tional time. 

In the following, we briefly review some specific findings that are of interest to educators and 
policymakers. 

• Controlling only for pretest differences, we find that slightly greater growth in achievement 
often results from increased amount of total instruction. Number of hours of instruction 
appears to be more sensitive to the relationship between instruction and achievement 
growth than the standard-resource-dollar index, which weighs different kinds of instruction 
according to the required labor-intensity. 

' • The amounts and patterns of services received by students are closely related to their 
achievement levels. J ower-achieving students receive greater amounts of services in patterns 
emphasizing instruction by special teaching staff and in small groups; while higher-achieving 
students receive lesser amounts with less emphasis on such special instruction. The practice 
of allocating services according to educational need can also be observed independent of 
student CE status. Generally, students from les* advantaged backgrounds tend to have 
greater need and receive more instruction, especially the special instruction. 
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The kind of instruction that most frequently shows positive effects on achievement growth, 
particularly in math, is regular instruction by classroom teachers in medium to large classes. 
Amount of special instruction which characterizes the services received by CE students, on 
the other hand, has mostly negligible, although often positive, effects on achievement. As a 
result, it is cpncluded that positive effects of CE cannot be explained by the kind of special 
instruction provided to the participants. Because such special instruction is often costly, the 
efficiency of service delivery in CE programs needs reexamination. 

In both reading and math, appreciable effects of the amount of regular instruction are more 
frequently noted within the group of Title I students than within other groups of CE or needy 
non-CE students. By comparison, amount of special instruction generally shows negligible 
effects, especially in reading, within the groups of CE and needy non-CE students. 

# 

Even after adjustment for differences in amounts of instruction received, CE programs often 
show positive impacts on the achievement of their participants, Title 1 students in particular. 
Such effects of CE are probably attributable to program characteristics other than instruc- 
tional time. The positive but modest impacts of compensatory programs are observed more 
frequently in math than in reading. 

The same model that relates the achievement process to student background, CE status, and 
receipt of instruction fits better for the math data than for reading. This suggests that reading 
achievement is a more complex process, possibly because there is a greater opportunity for 
learning to read outside the school; thus, reading achievement is influenced by a greater 
number of non-school factors. 

Selection for compensatory services is a primary factor for determining the pattern of instruc- 
tional services received. CE students, particularly Title 1 students, receive substantially more 
instruction from special teaching staff and in small classes than non-CE students, but less from 
regular classroom teachers in large classes. However, the net difference shows that CE 
students generally receive more total hours of instruction. As amount of special instruction 
does not exhibit substantially positive effects on achievement, the positive effects frequently 
found in Title I programs must be attributed to other educational factors, possibly better 
quality of instruction. 

Posttest achievement is predominantly determined by pretest achievement, especially when 
achievement scores are corrected for measurement errors. Other background factors and 
instructional time have very modest, though sometimes statistically significant, independent 
effects on posttest achievement. 

In reading, children from disadvantaged homes achieve better progress at the first grade than 
their more advantaged peers. This result is found independent of student CE status. This 
phenomenon suggests that children from deprived backgrounds generally have little oppor- 
tunity to learn primary reading skills prior to entering the first grade, but learn substantially as 
soon as they begin to receive formal instruction. In contrast, children from non- 
disadvantaged homes have already learned some of the skills before first grade and therefore 
do not necessarily learn new things from the same instruction. Asa result, the disadvantaged 
children improve more during the first grade than other children. However, this initial 
'benefit' from schooling for deprived children dissipates soon after the first year. In subse- 
quent grades, the relationship between socio-cultural advantage and achievement growth 
returns to the normal expectation of greater growth for children from more advantaged 
homes. 

The same benefit of initial exposure to formal instruction for the disadvantaged children is 
not evident in math achievement. Pre-school learning in math is not as prevalent as in 
reading, and children from all backgrounds can almost equally benefit from initial math 
instruction. Again, as the skills become more complex in later grades, the socio-cultural 
advantage factor tends to show a positive relationship with learning in math. 




Integrating the findings from these analyses, we conclude that amounts and kinds of instruction are 
not primarily responsible for the accelerated achievement of CE students. The positive effects of CE 
shown in our analyses probably reflect the effects of other educational practices. Exploratory 
analyses to study the effects of educational practices are discussed in part II of this report. Addi- 
tionally, comprehensive analyses are planned in forthcoming reports using three-year data (Report 
15), and in-depth observations of classroom processes (Report 16). Final judgments on the effects of 
CE and the roles of various educational experiences in achievement growth rest on these critical 
analyses. 

i % 

Possible reasons for the disappointing conclusion of the present analyses are: 

• The interval between pretest and posttest is too short to reveal any effects of instructional ser- 
vices if it requires a long-term effort to realize the benefits. This calls for investigations of the 
service effects on a continuous and long-term basis, as in later SES reports. The major 
drawback of a within-school year analysis is that any accumulated effects of services received 
in the previous years cannot be examined directly. Such effects are, in large part, absorbed 
into the pretest achievement. The inverse relationship between achievement and services at 
higher grades further undermines the possibility of revealing positive effects of amounts of 
instruction. 

*• The measures of instructional services fail to represent the amount of instruction directed to 
the material tested. This defect is more difficult to correct in a large-scale survey study. Fur- 
ther efforts in evaluating the effects of services may be more fruitful if they concentrate on in- 
depth observation of classroom instruction in small samples so that actual and relevant 
amounts of instruction can be recorded accurately. 

The use of in-depth observations in this study is illustrated in a later report on Successful 
Practices in High-Poverty Schools. 
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CHAPTER 4. CRITICAL LEVEL OF INSTRUCTIONAL 
EFFORT FOR IMPROVING THE ACHIEVEMENT 
GROWTH OF CE STUDENTS 



This chapter concerns the question whether there exists a /eve/ of effort above which CE 
students will achieve larger gains than norma/// expected of them, and consequent/y show 
a narrowing of the anticipated achievement gap between "them and regular students. 
Attempts were made to confirm the necessary condition for existence of such a threshold 
effort: a monotone and positive relationship between ach/evement growth and instruc- 
tional effort. In most case5, the evidence is tenuous that such a relationship exists 
throughout the range of efforts commonly observed in the current programs. Lacking clear 
evidence for a strong and positive relation, we were unable to determine a critical level of 
effort that would effectively raise the achievement status of CE students. 

Supplemental analyses were performed in order to provide more specific and detailed 
information on the achievement patterns of CE students in relation to the amount and 
intensity of services they received. Only in a few cases, the empirical data nearly substan- 
tiate the expectation of a monotonically increasing gain in ach/evement as the level of 
effort rises. Even in these cases, thgju&itive relationships are not strong. In many other 
cases the data show a slight tf^ftffoflarger gains for greater efforts in the middle range of 
****tforts, but a* the effort-lptei becomes very high, this trend is frequently reversed. 

Based on^ho^esults of the present analyses, it was concluded that there was not enough 
evidence tosufffs^^e concept of a 'critical lever of instructional effort for a meaningful 
reduction of the aau9^mvt^^uffered by CE students. Our chances of finding such a 
'critical level", if it PvrK -rnny^^nvff/ fry more refin ed measures of achievement 
growth and instructional effort and better analytic methods for studying their 
relationships. * 

In Chapter 2, the effects of CE on the achievement growth of its participants were assessed in terms 
of a variety ^of expectations (as estimated from norms, performances of appropriate comparison 
groups, and statistical models). The results provided the bases for evaluating the overall effects of CE 
at the national level. Clearly, the impacts of CE are of great importance for educational policy 
makers. But in order to obtain information that has relevance to making educational policies, we 
have to understand the educational factors that mediate the achievement growth. Only then can 
effective programs be designed and implemented for raising the achievement levels of disadvan- 
taged students. To this end, we began, in Chapter 3, an effort to search for explanatory factors for 
achievement growth through a close examination of the role of instructional services. The effort will 
later be expanded to include examination of the effects of a host of educational-process variables in 
Part II of this report. In this and the next chapter, we will address still a few more issues concerning 
the delivery of instructional services. u% 

Specifically, we are concerned with the existence of a critical level of instructional effort that is 
required for the anticipated achievement gap between the disadvantaged students and their non- 
disadvantaged peers to be reduced by a meaningful amount. This issue is of great interest because 
the answer can directly affect program emphases and policies for allocation of funds. The question 
is investigated first with a theoretical approach to determine if a critical level of effort indeed exists, 
and, if it does, what it is. 

The concept of a critical level is closely tied to that of a 'critical mass' which has been addressed 
directly or indirectly in many evaluation studies. It is a very attractive concept because, if shown to 
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exist, it would provide a basis for decisions on the distribution of CE funds and the amount of com- 
pensatory instruction to be offered. The key to success in finding such a critical level is the verifica- 
tion of the belief that achievement growth is a monotonically increasing function of the amount of 
effort (at least for a reasonable range of effort). 

Recently, Dougherty and Klibanoff (1977) reviewed previous studies germane to this question and 
confirmed an earlier conclusion by Averch and his colleagues (Averch, Carroll, Donaldson 
Kiesling, and Pincus, 1972) that there were no consistent relationships between resources (measures 
of effort) and effectiveness in raising achievement level The analyses undertaken by Dougherty and 
Klibanoff reached a conclusior^tttat there was little chance to demonstrate the existence of a critical 
mass. In the preceding two chapters, we found mixed results of CE effects and tenuous evidence for 
positive relationships between instructional services and achievement growth. These facts do not 
offer a very favorable prognosis for the present endeavor to find a critical level of effort. Never- 
theless, the investigation of this issue was pursued because of its importance and because a different 
approach was employed. Not too surprisingly, the analyses again have produced little evidence for 
the existence of a critical level of effort. Even so, a brief discussion of the work is presented in this 
chapter in hope that we can offer some insight into improvements for future studies in this area. 

^We present several descriptive analyses of instructional services provided to students at different 
levels of effort, graphs of achievement gains against discrete levels of effort, and results of analyses 
of variance using a nested design, so that information may be extracted to shed light on the relation- 
ships between instructional effort and achievement growth. In particular, the aim of the ANOVAs is 
to help determine whether, at certain levels of effort, achievement gains of CE students may begin to 
surpass those of the comparison groups. 

The supplemental analyses reveal that only in a few cases (e.g., in grades 4 and 6 for math), the 
average achievement gain for CE students consistently increases with increasing level of effort. 
However, even in such cases, the positive relationships are weak. Although in many other cases 
there is a small tendency for positive returns from increased effort at the intermediate levels of 
effort, this trend is frequently reversed by a decrease^of gain at the extremely high level of effort. 
Analyses by student characteristics and for different kincfe of CE programs did not clarify the picture 
appreciably. We think that improvement on the measures of achievement growth and instructional 
effort may be required for further progress in the inquiry on a critical level of effort. 

IS THERE A CRITICAL LEVEL OF EFFORT FOR A REDUCTION IN THE 
ACHIEVEMENT DEFICIT OF CE STUDENTS? 

To address this issue, we have to choose an index for the level of instructional effort. The educa- 
tional services received by students are a compound of various inputs, such as instruction by 
teaching personnel with different qualifications, additional assistance from non-teaching personnel 
such as aides, and use of materials and equipment. But the consideration of the concept of a critical 
level necessarily implies acceptance of a unidimensional measure of effort. The alternative of look- 
ing for a specific combination of the component services that is needed to effect the desired 
achievement gain proves extremely difficult, because of the complex interrelationships among the 
components. The combination of services required for a specified amount of improvement (or level 
of achievement) is probably not a unique one under most models assumed for growth. If one 
imposes a production mo^lel that artificially leads to a unique combination of inputs for a specified 
output, the results will be mostly unverifiable with empirical data. For these reasons, we adopted a 
single index for the level of instructional effort. 

The Measure of Level of Instructional Effort. Many previous studies dealing with the determination of 
a critical mass in compensatory education employed aggregated expenditure data at school or 
district levels. These expenditure data are distorted by price level differences among districts or 
regions, and do not fairly represent the amount of resources used. Although some kind of adjust- 
ment (e.g., by the local index of cost-of-living) is usually made, research based on these data has not 
been fruitful because they do not reflect direct resource-use in instruction for a specific subject area. 



Occasionally, significant differences in effects on achievement were found among different expen- . 
diture levels, and the finding was interpreted as evidence for existence of a critical mass (e.g., 
Coulson et al., 1976). However, this type of finding usually cannot be replicated, even in different 
years of the same study (see Coulson et al., 1977). 

To overcome the inadequacy of expenditure data for this kind of research, some Studies have 
developed specific resource-cost models to convert resource-use into resource-costs. These models 
are designed primarily to discount the price-level distortions. At the same time, they also recognize 
the importance of separating the resource-costs for a particular subject from those for other sub- 
jects, and for outlays tiot directly related to instruction (for example, building maintenance). In the 
SES, a resource-cost model that incorporates duly actual resources used in a subject into the 
calculation of costs has been developed to obtain standard-resource-dollar (SRD) costs for reading 
and math services. The resource-cost model was described in detail in Technical Report 6. The 
standard-resource-dollar costs (henceforth abbreviated as costs) were computed for each of the ten 
instructional items in the data-collection instruments, SPAR and SPAM (see Chapter 1), and then 
summed to yield a total resource-cost for each subject and each student. In each of the ten com- / 
ponents of services, use of materials, use of equipment, and other clerical assistance are also . 
included in the estimate of cost.- 

Because standard prices are applied to the resources used in all instructional programs, the total 
cost, in effect, is a weighted composite of the ten service items, with weights properly reflecting the 
labor-intensity of each item. The advantage of these differential weightings for the instructional 
items is that they provide a more sensitive distinction in receipt of services among students of dif- 
ferent CE status than can be achieved by amount of time alone (see Reports 5 and 6). For policy 
relevance, the level of effort should take into account the intensity of labor, the largest single 
category of educational cost. For the present analyses, we therefore decided to employ this measure 
of total cost as an index of the level of instructional effort. 

As this measure was also used in Technical Report 7 to study cost and effectiveness, it is important to 
note a slight difference between the cost model used in that report and the present one. In Report 7, 
teachers' years of experience and educational degree attained were disregarded in pricing the cost 
of a teacher's salary. In this report, we retain the differential prices according to a teacher's 
experience and education. This choice was made on grounds that the employment of teachers with 
different qualifications indeed reflects different amounts of effort in service delivery. An additional 
remark is that costs are computed on the basis of actual receipt of services in these two reports (i.e., 
they are adjusted by absences) rather than on the amount of services intended for the students. The 
readers are advised to keep these differences in mind when they compare the results discussed in 
different reports. 

Search For a Critical Level of Effort. The first step in the determination of a critical level of effort is the 
investigation of the relationship of the measure of effort (total cost) to some index of achievement 
growth. In Chapter 2, different measures of growth were employed to examine the achievement 
patterns of CE and non-CE students in order to assess the effects of CE. These measures are again 
used for the present analyses. They include four kinds of gain scores: 

• Z-score Gain. Posttest z-score minus pretest z-score, where z-score is the standard normal 
deviate corresponding to the percentile score. This index represents the expectation of main- 
taining the same relative achievement status from fall and spring. 

• Residual Gain A. Residual posttest score obtained by subtracting the predicted posttest score 
from the observed posttest score. The predicted score was computed based on the regres- 
sion model A, i.e., regression of posttest score on pretest score and student characteristics as 
estimated from data for non-CE students attending non-CE schools (see Appendix B5 for 
more explanation). 
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• Residual Gain B. Similar Jo Residual Cain A, but the Regression Model B, described in 
Appendix B5, replaced Model A. Regression Model B is a regression of posttest score on 
pretest score and student characteristics as estimated from data for non-CE students atten- 
ding CE schools. 

• VSS Gain. Posttest VSS score minus pretest VSS score. 

For each of these four gain scores, the relationship of achievement gain of CE students with cost for 
services was examined by regression analysis. Because patterns of instructional services that place 
different emphases on various kinds of instruction may affect the relationships, we also performed 
the same regression analyses for each of six subgroups of CE students whose receipt of services con- 
formed to the six instructional patterns explained in Chapter 3. In addition, both linear and cur- 
vilinear relations were considered (only the linear and quadratic models were fitted, as there was 
little evidence for higher-order relations). Thus, for each grade and for each subject (leading and 
math), 56 regressions (4 kinds of gain x 2 regression models x 7 analysis groups) were studied, 
resulting in a total of 672 regression equations. Few of these regressions supported the contention of 
monotonically increasing gains for increased costs. The division of CE students into six 
homogeneous subgroups of instructional patterns did not help us confirm the desired functional 
relationships between achievement growth and effort. Consequently, further discussion will be 
restricted to the analyses^ the sample of all CE students. The results of the regression analyses for 
all CE students are summarized in Tables D-1 and D-2 of Appendix D, for the linear and quadratic 
models, respectively. 

In the case of linear regressions showing positive relationships (see Table D-1), we go further to 
explore what amount of cost will produce a gain that brings the achievement level of CE students 
above the 'No CE' expectation for them. The rationale is that such a gain indicates that the 
anticipated (widening) gap between the CE students and their non-CE peers is arrested or is even 
narrowed. Similar investigations could be done for the quadratic case if there is a range of cost 
within which an increasing function of gain on cost is evident. However, the solution involves com- 
plicated iterative procedures and the regression analyses revealed no promising evidence for 
finding a reasonable critical level of cost. Therefore, we did not attempt such investigations for the 
quadratic case. 

The method used to locate a critical level of effort where the functional relationship between gain 
and cost appears to be positive is outlined below: 

The linear regression equation estimated in the analysis, in effect, provides the mean for the 
posterior predictive distribution of gains, given the observed data of costs and gains for CE 
students (see Box and Tiao, T973; or Zellner, 1971), The scale parameter for this distribution 
(which incidently is a t distribution) can also be calculated. Therefore, one can compute the 
posterior predictive probability that a CE student receiving services of a given cost, C, will 
achieve a gain greater than some specified criterion. This probability becomes a reference for 
the determination of the critical level of effort. 

A criterion of zero is chosen for the z-score gain, Residual Gain A and Residual Gain B, as the 
threshold that signifies some meaningful reduction of the achievement gap for CE students. 
This i: a reasonable criterion because without CE intervention, we would expect the CE 
students to maintain their relative achievement status ov^r time, or to progress like other 
non-CE students whose characteristics and ability are comparable to theirs. For the VSS Gain, 
two criteria are set, each anchored at the performance of one of the two comparison groups 
employed in Chapter 2. Explicitly, the average gains for the two groups of non-CE students 
judged to be in need of CE and attending CE and non-CE schools are considered as the 
expectations for CE students in the No-CE situation. 

A probability of .9 is adopted as an indication of some certainty that a gain equal to or larger 
than the criterion will be achieved with the given cost. This strategy shares the same rationale 
expounded in the norm-referenced analyses presented in Chapter 2. Thus, if the probability 
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explained in 1, above, exceeds .9, there is evidence to suggest that a reduction of the 
anticipated achievement gap will be attained by services equivalent to the given level of 
effort. In this way, the critical level of effort is determined by finding a cost level that yields 
the required probability of .9 for each criterion. The original intent is to specify a range of 
costs that represents the critical level of effort for gap-reduction by combining the estimated 
critical costs for the five criteria. The cases where it was possible to obtain a reasonable 
estimate of the critical cost were noted in Table D-1 . As seen in this table, our intent was not 
fulfilled as a result of the frequent failures to find a required positive relationship between 
gain and cost (in some different ways, data in Report 7 point to these same failures). 

Despite the unproductiveness of the analyses, they are discussed here so that future studies can 
benefit from our experience. The strategy we took for the determination of a critical level is a 
decision-based approach and could be useful for dealing with the problem of critical mass if the 
data can substantiate the expected positive and increasing return from increased instructional 
efforts. We cannot assess to what extent the index for effort itself is responsible for our inability to 
find positive relationships. The disproportionally high cost for special instruction that tends to show 
negative relations to achievement growth (see Chapters 6 to 8) is likely to be one of the major causes 
for the disappointing results. However, substitution of the total number of hour> of instruction for 
the total cost would probably not eliminate the problems, because the latter measure also suffers 
from lack of positive relationships with achievement growth. Besides, it does not include effort not 
directly recorded in the SPAR and SPAM (i.e., the use of material and additional personnel). Con- 
ceptually, the total cost is a better reflection of the intensity of effort than the amount of time. At this 
point, we are forced to conclude that there is little evidence to support the existence of a critxal 
level of effort. 

ADDITIONAL ANALYSES RELATING EFFORT TO ACHIEVEMENT GROWTH 

As we have made a serious attempt to find analytical solutions to the problem of critical level of 
instructional effort, but without avail, we now turn to a discussion of descriptive analyses in yet 
another attempt to uncover some relevant information from the wealth of our data. The remainder 
of this chapter therefore focuses on analyses of variance employing a design with nested factors in 
order to assess differences in achievement gains among CE students who received services at dif- 
ferent levels of cost (effort), and to compare their achievement gains with those of the non-CE 
students who were judged as needing CE but did not receive it. 

In addition, average achievement gains for CE students and the comparison groups are graphed 
against levels of cost for the services they received in order to allow a visual inspection of the rela- 
tionship. Supplemental data describing the numbers of hours of instruction received in different set- 
tings and the associated resource costs for the CE students and the comparison groups are provided 
in Appendix D. Finally, the relationships between instructional effort and achievement growth are 
examined for subgroups of students with different backgrounds in order to study the influence of 
student characteristics on such relationships. 

Descriptive Analyses of Services Received and Achievement Growth 

To aid us in understanding the relationships between instructional effort and achievement growth, 
we examined the profiles of services received and the patterns of achievement growth at different 
levels of effort (cost). In each grade, eight levels of cost were defined in terms of distances in half 
standard-deviation units below and above the mean for the distribution of total service costs in 
standard-resource-dollars over all CE students. Table D-3 of Appendix D presents the means and 
standard deviations (s.d.) upon which the levels were based. Costs that are less than or equal to 1 .5 
s.cf. below th e mean comprise the lowest cost level and costs that are greater than 1 .5 s.d. above the 
mean comprise the highest. The eight levels were obtained for reading and math services sepa- 
rately. Parallel analyses were performed for the two suH'jcts employing respective cost levels and 
data for services and achievement. 
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We first described the profiles of services received in ten instructional arrangements (as listed in 
SPAR and SPAM) by_CE students at each of the eight levels of effort. Then graphs of average achieve- 
ment growth as a function of the level of cost were made in terms of each of the four kinds of gain 
scores explained in the preceding section. The purpose of these analyses is to display the data in 
convenient ways that can be studied to arrive at a better understanding of the complex relationships 
between achievement growth and receipt of services. 
/ 

The second set of analyses compares receipt of services and achievement gains among five groups 
of student^ at given cost levels. The five groups comprise the three categories of CE students (Title I 
students^Other-CE students in Title I schools, and CE students in Other-CE schools), and the two 
comparison groups of non-CE students (students judged as needing CE but attending non-CE 
schools/ and non-CE students judged as needing CE and attending CE schools). In Chapter 2, we 
found ^bme overall differences in achievement gains among these five groups, and in Chapter 3, we 
examined the role of amounts of time spent in three different instructional settings (regular, special, 
and tjtitor/independent work) in explaining the differences. We now examine the differences in 
achi^vement^growth among the groups in the context of costs for services they received. For each 
group, we describe the service profiles by cost levels and prepare graphs of achievement growth 
against cost levels. The addition of the CE/comparison group factor to the descriptive analyses 
necessarily increases the volume pf data to be compiled. For ease of presentation, we replaced the 
ten instructional components with the three service composites employed in Chapter 3, and 
reduced the cost levels from eight to four by expanding the intervals to 1 s.d. (instead of the earlier 
half s.d.). The three composites of services would still afford us clear comparisons among the groups 
because each composite is formed on the basis of its ability to differentiate between CE and non-CE 
students. 

i 

At f each fixed level of effort, we compare receipt of services between CE and non-CE students 
because even if thf >v receive services at comparable costs, the patterns of services they receive may 
still differ and affect their learni ig differentially. If there is little difference in cost as well as in pattern 
of service delivery among the groups, then any differences in achievement growth among them are 
unlikely to be explainable by the service factor. In this case, we have to look for other factors to 
' explain achievement differences. 

Services Received by CE Students and Their Achievement Growth, by Level of Effort In Tables D-4 
and D-5 of Appendix D we tabulate average hours and costs of services received in the ten instruc- 
tional components for each of the eight cost levels of reading instruction. Tables D-6 and D-7 pro- 
vide parallel data for math. Examining the proportional allocation of the total services to the ten 
components, we find chat emphasis of instruction in small groups (1-6 students) and by special 
teachers increases with increasing levels of cost. At the highest cost level, these kinds of reading 
instruction account for more than 50 percent of the total service costs as well as total instructional 
time for CE students. In math, they account for more than 40 percen of services at the highest level 
of cost. Comparisons of the corresponding proportions for time and cost make explicit the promi- 
nent determinants of service costs. Specifically, high costs are overwhelmingly associated with small 
instructional groups and, to a lesser extent, with employment of special teachers. The data in these 
tables also show that differences in receipt of services among CE students across the cost levels are 
primarily observed in these kinds of special instruction, as are differences between CE and non-CE 
students (seelfeport 5). 

With increasing levels of cost, classroom instruction and independent work account for decreasing 
proportions of services received. Comparisons across grade levels reveal that the average use of 
aides declines with increasing grade, whereas large classroom instruction increases (at least through , 
the sixth grade). In terms of the average total services across cost levels, we see that in reading the 
amount of services decreases with increasing grade level. This conforms to the notion that since 
reading skills are necessary for much of school learning they must be emphasized in the early years. 
In math, on the other hand, we see that the average number of total service hours (thus, the cur- 
ricular emphasis) regains about the same from year to year though slightly more effort is expended 
in grades 3 through 5 where complex and novel concepts are introduced. 
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The relationships between the achievement growth of CE students and the level of costs for the ser- 
vices they received are illustrated in Figure 4-1, with VSS gains as the measure of growth. There, the 
average gains for CE students are plotted at eight levels of cost. Similar data using Z-Score Gain, 
Residual Gain A, and Residual Gain B (see earlier descriptions) as the indexes of growth are 
presented in Appendix D, Figure D-l for reading and D-2 for math. , 

Examining the graphs in Figure 4-1, we can discern a nearly consistent pattern of increasing gains 
with increasing cost levels only in grades 4 and 6 for math. Additionally^sjjghtly positive trends may 
be seen in grades 3, 5, and 6 for reading, and in grades 1 and 5 for math. However, in these 
instances, the curves fluctuate so much that no clear relationships between level of effort and 
achievement growth can be inferred with confidence. In most cases, the patterns of gains vary with 
the ranges of cost and periodically show decreasing trends as cost levels rise. The decreasing trends 
are especially noticeable in grades 1, 2, 3, and 5 for reading and in grades 2 and 3 for math when 
costs are at the two highest levels, although the importance of these findings rrMvbe undermined by 
the small sample sizes for these data points. 

Comparison of the curves in Figure 4-1 with the corresponding ones in Appendix D reveals that the 
findings are generally similar when different indexes of growth are employed. But, there are occa- 
sionally marked differences. In particular, in grade 3 for math, the picture for z-score gain shows 
striking departure from the other three graphs for different indexes of growth. On the whole, the 
relationships between level of instructional effort and achievement growth are not consistently- 
positive, and are not affected by the index of growth. 

The irregularities of the curves in these figures vividly demonstrate the difficulties for fitting smooth 
functions with a positive trend to the data. Among the probable reasons for these irregularities are 
the low reliabilities of gain scores, the allotment of services in accordance with needs, and the 
influence of outliers. It is possible that development of better indexes for growth, careful scrutiny of 
unruly outliers, and use of robust regression procedures (Hogg, 1974) could improve the situation. 
However, we are not optimistic in this regard, considering the frequent and disorderly fluctuations 
of the curves. Until we can confirm the positive ties between achievement growth and instructional 
effort, the search for a critical level of effort cannot be fruitful. 

In summary, CE students receive increasingly more instruction in small groups and from special 
teaching staff as the cost level for the service increases. But the increase in amount and intensity of 
instruction does not always result in greater achievement growth. The lack of a systematic and 
positive relationship between achievement growth and instructional effort largely explains the 
failure in our theoretical approach to locating a critical level of effort for narrowing the anticipated 
achievement gap between ^E students and their non-deprived peers. 

J 

Comparison of Services Received Between CE and Needy Non-CE Students. The average costs of 
reading and math services are presented in Table 4-1 for three groups of CE students and two com- 
parison groups of non-CE students who were judged as needing CE. As shown in this table, Title I 
students on the average received services at the highest cost among the five groups. This observa- 
tion applies to most grades and to both reading and math. The few exceptions were found in the 
first two grades where CE students in Other-CE schools sometimes received services at higher cost 
than that for Title I students. It is also clear that the two comparison groups of non-Hi students 
generally received services of considerably lower cost than any CE group (with rare exceptions in 
the first two grades for math). Indeed, the earlier finding (see Chapter 2) of greater progress for Title I 
students is accompanied by higher costs for services they received. However, as also observed in 
Report 7, the substantial increases in service costs for Title I students (reaching an amount of more 
than 50 percent above th^costs for the comparison groups in the upper grades) render the 
increased gains, when founcT insufficient to demonstrate the cost-effectiveness of CE. 
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Note. — Numbers of cases on which means are based can be found in Table D-4 for 
reading and Table D-6 for math. 

Figure 4-1 

Average Fall-to-Spring VSS Cains (Vertical Axis) in Reading and Math for CE Students; 
by Levels of Service Costs (Horizontal Axis, Indexed by Number of Standard Deviations 
Away From the Mean Costs for All Students in the Subject) 
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Table 4-1 

Mean Total Standard-Resource-Dollar Costs for Reading and Math Services 
Received in 1976-77 for Three Groups of CE Students and Two Comparison 
\ Groups of Non-CE Students Judged as Needing CE* 



CE Status 







Title I 


Other-CE 


CE 


Needy 


Needy Non-CE 


Grade 




Students 


Students 


Students 


Students 


Students 






in Title I 


in Title I 


in Other-CE 


in Non-CE 


in CE 






Schools 


r Schools 


Schools 


Schools 


Schools 


Costs 


for Reading Services 


Received 






• 


1 


N 


l,55o 


519 


339 


304 


1,240 




Mean 


428.7 


390.7 


447.8 


339.5 


364.1 


2 


N 


• i#«>5 


583 


426 


320 


950 




Mean 


428.4 


376 . 1 


443.5 


297.8 


346.5 


3 


N 


1,702 


478 


412 


323 


902 




Mean 


392.3 


344.4 


391.7 


305.2 


317.0 


4 


r 

N 


1,318 


410 


402 


340 


1,046 




Mean 


384.4 


335.8 


322. 2 


226.2 


258.6 


5 * 


N 


1,225 


394 


"385 


266 


1,187 




Mean 


333.8 


282.2 


312.6 


219.8 


223.5 


6 


N 


1,126" 


539 


351 


351 


1,367 




Mean 


336.9 


228.5 


280.5 


207.8 


207.3 


Costs 


for Math 


Services Received 








1 


N 


772 


426 


210 


591 


966 




Mean 


203.0 


142.5 


197.2 


144.3 


150.8 


2 


N 


902 


477 


165 


555 


' 762 




Mean 


198.8 


149.1 


205.6 


135.0 


184.9 


3 


N 


920 


385 


250 


615 


818 




Mean 


228.4 


< 187.4 


196.7 


150.5 


161.8 


4 


N 


710 


394 


255 


671 


821 




Mean 


255.0 


277.3 


210.7 


149.1 


174.3 


5 


N 


716 


350 


246 


723 , 


936 




Mean 


260.0 


203.8 


204.2 


158.8 


- 160.6 


6 


N 


642 


549 


246 


739 


1,061 




Mean 


241.3 

■v 


172.3 


189.9 


176.3 


141.7 



Only ca^es having complete data, in CTBS fall and spring scores, student background 
characteristics, hours and costs of services received, and CE st tug were included 
in the present analyses. 
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When we consider the initial achievement status for the five groups, the differences in receipt of ser- 
vices among them become easier to understand. Referring to Tables E-1 and E-2 in Appendix E, if 
may be seen that in both reading and math, Title I students tend to have the lowest pretest scores at 
all grades. The receipt of services at the highest cost by Title I students in grades 3 through 6 suggests 
that there is a tendency to allocate services based on educational need. On the other hand,"in 
grades 1 and 2 for reading and in grade 2 for math, CE students in C her-CE schools received ser- 
vices at higher cost than Title t students in spite of the lower achievement status^of Title I students. 
This finding runs counter to our expectation of more intensive services for Ibwer achievers, and may 
# be an indication that Other -CE schools tend to concentrate services of high labor-intensity on ;he 
early grades. Comparing the two groups of needy non-CE students, those attending non-CE schools 
received services at lower costs. As needy non-CE students in non-CE schools also achieved lower 
average pretest scores, this result led us to suspect that there might be some kind 6f additional 
remedial effort in CE schools, or there might be some spillover of CE services to the non : CE students 
who were judged to have need for CE. The unintended benefit to the needy non-CE students in CE 
schools could result from the schools' general efforts to upgrade services for their students. 

The comparisons of services received by different groups of students are also made at various levels 
of cost. In Tables D-8 and D-9 of Appendix D. .verage hours and costs for reading services received i 
in three kinds of instructional settings are tabulated by four levels of total resource-cost, for each of 
the five CE and non-CE comparison groups. Tables D-10 and D-11 in the same Appendix present 
parallel data for math. It is important to note in these tables that students in the five groups are not 
distributed in the same way across levels of cost. In math, the distribution is skewed for Title I 
students in that a greater proportion of them received services at high costs than at low costs. This 
characteristic is much less pronounced in reading where the distribution of Title I students is almost 
symmetrical about the average cost for all CE students. In both reading and math, services at costs 
that are below the average for all CE students are typical for Other-CE students in Xitle I schools. The 
pattern of costs for reading and math services received by CE students in Other-CE schools changes t 
with grades, such that in the first two grades the distribution is approximately symmetrical; 
however, in the upper grades, services at costs that are lower than the average for all CE students 
are provided to them more frequently. As expected, the majority of the non-CE,students in the two 
comparison groups received services at costs lower than the average for all CE students. However, 
there v%ere still many students in these comparison groups who received services at considerably 
high cost. ( 

Inspection of the four tables (D-8 to D-11) for comparisons among groups with respect to mean 
hours of services reveals similar patterns across coot levels. That is, as emphasis cn special instruc- 
tion increases, cost for services increases. Within a cost level, the allocation of services to the three 
kinds of instruction differs little among groups except at the lowest cost level. At the highest cost 
level, more than half of the time for reading services is spent in special instruction. For math, the 
proportion of time allocated. to special instruction at the highest cost level sometimes drops slightly 
below 50 percent but mostly stays above it across all groups and all grades. By contrast, at the 
lowest cost level, the profile of instruction for CE students resembles that projected for the SES 
population (see Table CM in Appendix CD; about 16 to 21 percent of the time for reading services 
and about 10 to 15 percent for math are spent in special instruction. However, for the tWQ non-CE 
com^atisorTsgroupi, the. proportion allocated to special instruction at this low level of costs falls 
noticeabiylhart of t he population value. The upshot of thK discussion is that differences in services 
received between the CE and neecjy non-CE students exist not only in terms of total resource-costs, 
but may also be in terms of the ways in which the efforts are allocated. 

Relationship Between Achievement Growth and Receipt of Services for Different Croups of CE and 
Needy Non-CE Students. Because the educational programs for CE and Non-CE students are, in 
theory, different, we are concerned that the relationships between achievement growth and instruc- 
tional effort may differ among the five grpups of students. Even at comparable levels of effort and 
with similar allocation of instructional time, the students in different programs may experience dif- 
ferent educational practices in other aspects. To address this concern, we examined the relation- 
ships between growth and effort for different groups of students separately. For this purpose, the 
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average VSS gain is plotted as a function of cbst levef for each of Xhefrfe groups, in Figure 4-2 for 
reading and in Figure 4-3 fpr math. Similar graphs are also prepared^ing the other three indexes of 
growth (z-score gain and two kinck of residyar gain scores), agJi^Jresented in Fig-res D-3 through 
D-S of Appendix D. . ^ . *HJy # * 

The graphs in Figures 4 2 and 4-3 "d^^^f^S^^\Vi Figure 4-1, that few of the relationships 
between growth and effort are monotonicaflly incasing. Clearly, small sample sizes for several of 
the data points (particularly at the lowest ap^the highest cost levels) may result in unstable 
estimates of mean growths and inaccurajj^feflections of their relationships with efforts. But the 
departures from monotonicity ire frequpmly too noticeable to be attributed entirely to such errors. 
Although the relationships appear to cfiffer among groups, there are no clear patterns for the dif- 
ferences. Within each group/the relatibnsnips are generally similar for the four different indexes of 
% growth; erratic fluctuations of averse growth across cost levels are common regardless of which 
index is employed. ' ' 

An advantage of displaying the curves for different groups in a same graph is that it facilitates the 
comparisons of achievement growth among the groups at specific levels of effort. Examining the 
graphs, we find that, at the same cost-/eve/, CE students often do not achieve greater gains than 
needy non-CE students. Title I students consistently exhibit greater gains than needy non-CE groups 
only in grade 1 for reading and in grades 3 and 4 for math. The result showing infrequent cases of 
systematically larger gains for CE students at fixed cost level comes as no surprise to us. So far we 
h*ave been able to show only that proportionally more CE students received services flt higher cost 
than non-CE students whose teachers considered them having need for CE. However, for a given 
level of effort, there has been little evidence of differences among the groups with respect to time 
'allocations (the only exception being when leveLof effort is low). Furthermore, it was found in 
Technical Report 5 that there were no appreciable differences in exposure to a variety of educa- 
tional practices between CE and non-CE studentsT These findings suggest that CE and non-CE 
students are not likely to learn differently if they are comparable in educational disadvantage and 
receive comparable services. 

In light of these results, we conclude that there is no convincing evidence for a systematic and 
positive return from increased effort in instruction, even when the relationships are examined 
separately for homogeneous groups of students who were exposed to similar programs. In general, 
the relationships between achievement growth and level of effort are inconsistent across the groups 
and the grades. The graphic displays of the data clearly indicate that services associated with higher 
cost do not necessarily result in greater 'growth. This lack of positive relationships is common for the 
three groups of CE students as well as for the educationally needy non-CE students. These findings 
suggest that analysis for separate groupfs of CE students by funding sources of their programs would 
not improve the chance to find a 'critical level of instructional effort' 'or the reduction of their 
expected achievement deficits. 

Conclusion From the Descriptive Analysis. The analysis of services received by CE Students and their 
achievement patterns at different levels of effort reveals that, as intended, CE programs have pro- 
vided services associated with high cost to more educationally deprived students than regular pro- 
grams; but services at high cost do not clearly produce a positive return in achievement gains. Ser- 
vices at high cost are typically characterized by emphasis on small-group instruction and, to a lesser 
extent, on employment of special teaching staff. Our results suggest that other catalysts for educa- 
tional progress would be required ; n order to overcome the educational disadvantage of CE 
students. However, as will become clear in P^rJ II of tk\s report, we are still a long way from being 
able to determine exactly what elements of the educational processes constitute effective remedies 
for deficiency. 
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Note. — Numbers of cases on which means are based can be found 
iri Table D-8. Means based on fewer than 5 cases are 
not plotted . 



Figure 4-2 

Average Fall-to-Spring VSS Cains (Vertical Axis) in Reading for the Three Groups 
of CE Students and Two Croups of Non-CE Students Judged as 
Needing CE, by Levels of Service Cost (Horizontal Axis) 
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Figure 4-3 

Average Fall-to-Spring VSS Gains (Vertical Axis) in Math for the Three Croups 
of CE Students and Two Groups of Non-CE Students Judged as Needing 
CE, by Level of Service Cost (Horizontal Axis) 
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Examining the Effects of CE by Level of Instructional Effort 

In order tc study the effects^ £E in relation to instructional effort, an analysis of variance design 
was adopted in which CE students were divided into subgroups by levels of standard-resource- 
dollar cost and funding sources for the services they received, whereas the two non-CE comparison 
groups were included as intact groups. In other words, this program (treatment) factor consists of 
three groups of students. CE students, needy non-CE students in non-CE schools, and needy non-CE 
students in CE schools. Nested within the CE group are three categories of CE students (Title I 
students, Other-CE students in Title I Schools, and CE students in Other-CE schools), each of them is 
further subdivided into four levels of cost for services. The complete layout of this design is 
explained in Tables D-12 and D-1 3 of Appendix D. These analyses compare the achievement gains 
for CE students receiving services at different costs with the overall gains for the two non-CE com- 
parison groups, which serve as estimates of expected gains in the 'No-CE' situation. These com- 
parisons were aimed to determine at which levels of effort a particular group of CE students would 
achieve better than the 'No-CE' expectations. The analyses were performed for reading and math 
separately, and for the four different indexes of growth (VSS gam, z-score gain, and two kinds of 
residual gains). 

Tables D-12 and D-13 also present the mean gain and sample size for each cell in the design, for 
reading and math, respectively. In addition, significance tests for five effects are included: un- 
adjusted treatment effects; main effects of the treatment factor, CE category, and cost level adjusted 
for each other and interactions; and the interaction effects between CE category and cost level 
adjusted for their main effects. Our principal interest is to examine the influence of cost level on the 
effects of CE. 

Results of the Analysis of Variance for Reading, The overall relationships between level of effort and 
achievement growth are insignificant at the .01 level in all grades with rare exceptions. But, in 
grade 3, the interaction between CE category and cost level shows significance for three of the four 
measures of gain. I n this grade, whereas there is no apparent cost-level effect for Title I students, the 
effect of cost level for other-CE students is such that considerably higher gains are obtained at the 
highest cost level for those in Title I schools, and at the next-to-highest level for those in other-CE 
schools. In either case, the average gain exceeds the averages for both groups of non-CE students. 
However, there is no clear explanation for this finding in a single grade. 

The adjusted mam effects of CE category are consistently significant (at the .01 level) in grades 1 
and 6, regardless of which index of growth is used. In the top section of Table 4-2, we present the 
marginal mean gains for each of the three subgroups of CE students in these two grades, along with 
the means for the two groups of needy non-CE students. As shown there, Title I students achieved 
the highest average gams among the CE subgroups, exceeding those for both groups of needy non- 
CE students. Although not presented in the table, the least-square estimates of these means that 
have been adjusted for the unbalanced sample sizes confirm the same finding. 

As Title I students tend to achieve lower pretest scores than other-CE students, we suspect that 
regression artifacts may affect these mean differences. The top section of Table 4-3 gives the average 
percentile scores at pretest for the same five groups of students, by cost level. 

Indeed, Title I students tend to have the lowest pretest scores among the CE students; but their 
scores are generally similar to those for the needy non-CE students. Within each CE group, pretest 
achievement status tends to be inversely related to cost level. These data suggest that the regression 
phenomenon may affect our findings. However, it is important to remark that the average gains for 
the groups do not exhibit the reversed rank-orders of their pretest scores. This observation and the 
sizeable differences in means support our contention that there is evidence for greater effects of CE 
for Title I students than for Other-CE students. 
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Table 4-2 



Mean Achievement Growth for the Three Croups of CE Students and the 
Two Comparison Croups of Non-CE Students Judged To Be in Need of CE, for Grades 
1 and 6 in Reading and for Grades 3 and 4 in Math 



Grade 



Index of 
Achiement 
Growth* 



Title I 
Students 
in Title I 

Schools 



CE Categories 



Other-CE 
Students 
in Title I 
Schools 



Other-CE 
Students 
in Other -CE 
Schools 



Needy Non-CE 
Students 
in Non-CE 
Schools 



Needy Non-CE 
Students 
in CE 
Schools 



Reading Achievement 





Z-Score Gain 


0.05 


-0.12 


-0.18 


-0.07 


-0.07 




Residual Gain A 


6.78 


-2.76 


-5.06 


0.43 


3.84 


1 


Residual Gain B 


4.22 


-4.19 


-5.46 


-2.75 


0.30 




VSS Gain 


61.38 


56.88 


53.46 


53.50 


54.92 




Z-Score Gain 


0.05 


0.01 


-0.05 


0.01 


-0.00 




Residual Gain A 


-3.33 


-2.03 


-10.82 


-6.21 


-5.94 


6 


Residual Gain B 


6.57 


1.85 


-0.81 


2.97. 


2.96 




VSS Gain 


27.67 


25.57 


20.74 


24.98 


24.28 


Math 


Achievement 














Z-Score Gain 


0.13 


0.01 


-0.09 


-0.05 


-0.04 




Residual Gain A 


15.40 


-2.72 


1.44 


-0.07 


2.60 


3 


Residual Gain B 


-1.40 


-8.55 


-10.35 * 


-7.77 


-7.83 




VSS Gain 


55.98 


51.27 


49.75 


50.59 


48.86 




Z-Score Gain 


0.07 


-0.01 


-0.21 


-C.02 


0.00 




Residual Gain A 


1.28 


-0.32 


-13.86 


-1.38 


1.14 


4 


Residual Gain B 


-5.04 


-2.51 


-18.51 


-11.33 


-9.14 




VSS Gain 


52.20 


50.23 


34.58 


46.45 


48*55 



Two kinds of residual gain were fobtained as observed minus predicted posttest score. 
For residual gain A, a regression equation ^estimated with data front non-CE students 
attending schools that do not provide CE in the subject area was employed, to compute 
the predicted posttest score. ForVresidual gain B, the regression equation was es- 
timated with data from non-CE students attending schools that provide CE in the sub- 
ject area. For descriptions of the Regression models used, see Appendix B5. 
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Table 4-3 



Average Pretest Percentile Ranks for the Three Groups of CE Students and the Two Groups of 
Non-CE Students Judged To Be in Need of CE, by Cost Level of Services Received for 
Grades 1 and 6 in Reading and for Grades 3 and 4 in Math 



CE Categories 







Title I 


o v her~CE 


Other-CE 


Needy Non-CE Needy Non-CE 


Grade. 


Cost Level*. 


Students 


Students 


Students 


OLUQtlllLb 


Q t- 1 1 rl on q * 
O LUucllLb 




f 


in Title I 


in Title I 


in Other-CE 




in CE 






Schools 


Schools 


Schools 






Reading Achievement 














Low 


34.6 


45.5 


31.0 


20.2 


30.8 




Low Average 


31.9 


46.6 


42.0 


30.5 


28.5 


1 1 


High Average 


31.8 


37. 8 




25.8 


31.9 




High 


28.7 


31. 9 


35.6 


24.1 


31.0 




Total 


31.7 


42.9 «■* 


40.0 


26.4 


29.9 




- Low 


31.3 


45.4 


34.5 


27.1 


31.3 




Low Average 


20.7 


37.6 


24.2 


23.2 


28.4 


6 


High Average 


17.6 


9*\ n 


1 Q A 


15.5 


25.7 




High 


18. 5 


15.8 


19. 5 


11.3 


21.9 




Total 


20.0 


36. 1 


23.7 


23.4 


28.8 


Math 


Achievement 














Low 


27.8 


39.0 


29.7 


26.9 


26.4 




Low Average 


28.3 


45.2 


40.1 


25.0 


27.3 


3 


High Average 


25.7 


29.7 


29.5 


25.4 


28.9 




High 


26.1 


24.9 * 


34.7 


24.6 


25.2 




Total 


27.1 


39.1 


36.6 


25.8 


27.1 




Low 


37.0 ' 


48.*9 


60.0 


24.3 


28.5 




Low Average 


25.9 


42.7 


39.5 


26.3 


27.8 


4 


High Average 


25.1 


37.2 


34.4 


21.0 


24.0 


\ 


High 


22.0 


25.3 


17.4 


22.6 


18.5 




Total 


26.0 


40.1 


37.1 v 


25.6 


26.9 



The four cost levels for reading/math are defined in terms of the mean and standard 
deviation (s.d.) of the total resource cost of services for all CE students within each 
grade as follows: Low = one or more s.d. below the mean; Low Average ■ zero to one s.d. 
beP.ow the mean; High Average = zero to one s.d. above the mean; High = one or more s.d. 
above the mean. The lower end point of each level is excluded from that level. 



Further examination of the cell means in Table D-12 discloses that the positive effects of CE for Title I 
students in grades 1 and 6 become evident at the two high cost levels, which represent services at 
cost higher than the average for all CE students. The positive payoff for high-cost services, however, 
may not be large enough to be cost-effective (see Report 7). 

Additionally, both unadjusted and adjusted main-effects for the treatment factor (CE vs. Non-CE) are 
significant in grades 3 and 5, when the two residual gain scores are analyzed. In grade 3, the direc- 
tion of difference is in favor of the needy non-CE students in CE schools. In grade 5, when residual 
gains are obtained based on data for non-CE students in non-CE schools, average gains are higher 
for CE students, regardless of cost levels, than for either group of non-CE students., The only excep- 
tions are found at the lowest and highest cost levels for other-CE students in Title I schools. 
Elsewhere, occasional significances are obtained without consistency over measures of gain or 
grades. Such scattered significances generally do not lend themselves to clear interpretations and 
are likely to be the result of chance. 
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Results of the Analysts of Variance for Math. More interaction effects between cost level and CE 
category are significant in math than in reading. These findings are consisted* across measures of 
gain in grades 3 and 4. In addition, the adjusted main-effects for CE category and for cost level are 
also consistently significant in these two grades. To aid us in interpreting these results, marginal 
mean gains and average pretest percentile scores by cost levels are presented in the bottom sections 
of Tables 4-2 and 4-3 respectively, for the three groups of CE students as well as the two non-CE 
comparison groups. The data in Table 4-3 again show a systematic inverse relationship between 
pretest achievement status and cost level in grade 4 for all groups. Such an inverse relationship also 
holds in grade 3 but with occasional violations. Among the CE students, Title I students tend to have 
the lowest initial achievement status which is comparable to that for the two groups of needy non- 
CE students. The initial achievement status for other-CE students is considerably higher than for the 
other groups. 

Examining the"marginal means in Table 4-2, we find that Title I students usually attained larger gains 
than did other groups. In all cases, mean gains for Title I students exceed those for either group of 
needy non-CE students. Again, data in Tables 4-2 and 4-3 suggest that regression artifacts do not 
account for much of the differences in gains among the groups. With respect to levels of cost, the 
only marked effects are observed at the two higher-than-average cost levels for Title I students 
where their gains clearly and consistently exceed the gains for all other groups (subgroups of other- 
CE students at any cost level and the two groups of needy non-CE students). Thus, the results point 
to a positive return from services at increased cost, specifically for Title I students in these two 
grades. The least-square estimates of means support the same findings. 

tn both grades 3 and 4, the interaction effects between CE category and cost level largely reflect the 
much lower gains for other-Cf students at the highest cost level. In grade 3, lower gains at the high 
cost levels are obtained also for other-Cfc students in other-CE schools. We suspect that sometimes 
other-CE funds are expended to provide services at high cost to students because of special learning 
problems and such services may not be aimed directly at improving achievement. 

Other significant findings worth noting include: consistently significant unadjusted treatment-effects 
for all measures of gain in grade 1; significant adjusted treatment-effect for z-scoregain and VSSgain 
in grade T, and significant adjusted main effects for the treatment factor and for CE category for both 
kinds of residual gain in grade 5. In all these cases, the directions of differences are in favor of CE 
students, Title I students in particular. The advantages for GE students are particularly noticeable 
when they receive services at high cost. In the remaining cases, significances are obtained infre- 
quently and without any systematic pattern. 

Conclusions from the Analysis of Variance. In summary, the evidence for positive relationships 
between achievement gains and amount of effort remains inconclusive. The results of these extra 
analyses do not offer a more promising future for the search of a critical levej of instructional effort. 
However, they do provide more detailed and specific evidence for some positive returns from 
intensive instructional efforts than do the earlier results obtained with a regression approach using 
data for all CE students. 

Further Analysis by Student Characteristics 

The relationship between instructional effort and achievement growth may, in fact, be moderated 
by differing background characteristics: different kinds of students may benefit differently from 
increased services. If this were the case, it could help explain the inconsistent and generally 
insignificant relations between inltructional effort and growth. In other words, by considering stu- 
dent characteristics, we may be able to clarify the picture. 

In this section, we examine the relationships between achievement growth and effect for subgroups 
of CE students with different background characteristics. Our primary interest is in the interactions 
between cost level and student characteristics. Four student characteristics are used in the analyses: 
white/minority status, participation in free-meals program, need for CE as judged by teachers, and 
initial achievement quartiles. In Tables D-14 through D-17 of Appendix D, we tabulate the mean 
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reading achievement gains by level of effort (cost) ,ind groups of different student characteristics, 
one table for each of the four measures of gain. Tables D-18 through D-21 present parallel tabula- 
tions for math gain scores. Significant tests are provided for the adjusted effects of instructional 
effort, and the interaction between effort and student characteristics. 

Results of the Analysis for Reading. Examining Tables D-14 through D-17, we find that few of the 
interaction effects are significant (at the .01 level). For the most part, we conclude that there is little 
interaction between effort and student characteristics in terms of reading growth. However, signifi- 
cant interaction effects are occasionally found between effort and race in grades 4 and 6 for some 
indexes of gain. In such cases, inspection of the mean gains reveals a trend of increasing gains with 
' increased costs for minority CE students, but not for white ones. Additionally, the interactions 
between level of effort and participation in a free-meals program are significant for three measures 
of gain (except for z-scofe gain) in grade 5. In this case, there is not a systematic trend for relation 
between gain and cost for either the participants or non-participants. These infrequent instances of 
interaction appear to be not very meaningful and probably are best regarded as results of chance. 

Adjustments made for the effects of student characteristics apparently have little influence on the 
significance of cost-level effects. From these tables, it can be seen that in reading, only a few 
adjusted cost-level effects are significant. Specifically, significant results are consistently obtained in 
grade 6 for all but one of the measures of gain. In this grade, adjustment for either race, free-meals 
participation, or CE need^results in a systematic trend showing an association of increases in effort 
with increases in gain. In fact, the same trend is observed even without adjustment for these 
characteristics, and also within each subgroup of different characteristics, indicating that there are 
no interactions involved. 

The remaining significances for adjusted cost-level effects are found without any consistency over 
grades or measures of gain. In most of these cases, achievement gains tend to increase with cost 
. until the high-average level and then drop off at the highest cost level, regardless of which student 
characteristic is employed as the adjustment factor. The evidence for this phenomenon is, however, 
not strong, and it might be largely a result of chance variations due to small sample sizes, although 
one might also suspect some inefficiency of services at unusually high cost. 

In passing, it is of interest to note a few miscellaneous observations from these tables. First, in 
grade 1, but not in the upper grades, there is a consistent finding that non-white CE students tend to 
achieve appreciably higher gains than the white CE students at every cost level. This finding might 
suggest that because the horrH environment of the minority students provides relatively fewer 
opportunities for learning, they tend to benefit more from instruction at the outset of schooling in 
comparison with the whites. However, such advantage dissipates gradually as these students pro- 
gress through the grades. A similar finding has already been noted in Chapter 3. Second, the present 
analyses fail to discover any striking differences among the measures of gain in their ability to detect 
cost-level effects. 

Results of the Analysis for Math. Examining Tables D-18 to D-21 in Appendix D, we again observe 
few significant interactions between effort and student characteristics. The only consistent interac- 
tions are found between CE-need and cost level in grade 4, for all four measures of gain. In this case, 
average gain in math i& monotonically and positively related to cost for CE students judged to have 
need for CE, but not for those without such need. 

Considerably more significances for adjusted cost-level effects are found in math than in reading. 
Adjustments for white/minority status, participation in free-meals program, or CE-need systemat- 
ically reveal significant main effects of cost level in grades 1, 4, and 6 with few exceptions. These 
% findings are generally consistent over the four measures of gain. In grade 1 , there is a tendency for 
achievement gain in math to increase with cost through the third cost level (high-average l< /el), 
followed by a slight decrease at the highest cost level. In grade 4, there is a steady trend for nath 
gam to increase with increased effort. In contrast, an aberrant data point exists at the third cost level 
in grade 6, where the average gain is usually low regardless of which index is used. Ai in reading, 
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there is evidence that the non-white CE students in the first grade tend to benefit more from services 
at a high cost level than the white CE students, probably again explainable by their different 
experiences prior to the first grade. 

Conclusions from the Analysis by Student Characteristics. There are few interactions between cost 
level and student characteristics with respect to their effects on the achievement growth of CE 
students. Furthermore, adjustment of the cosMevel effects by the differences in student 
characteristics does not result in a drastic change of our previous conclusion regarding the weak 
relationship between achievement growth and instructional effort. It is, however r a consolation to 
note that there is some scattered evidence for positive relationships, and in no instance is prominent 
evidence to the contrary observed. 

INSTRUCTIONAL EFFORT AND GROWTH IN PRACTICAL ACHIEVEMENT 

In addition to examining achievement gains on standardized tests, we also compared gains on the 
Practical Achievement Scale (PAS) in grades 4 through 6. Because it requires skills in both reading 
and math, PAS gains are presented for various levels of effort in reading and math. In Tabje 4-4, the 
raw-score gains are examined, while two kinds of residual-gairi scores are examined in Table D-22 
of Appendix D. Students represented in these tables are CE students in reading and/cr math. As 
reading CE programs are much more widespread than math CE programs, fewer of these students 
participate in math CE than in reading. In general, reading CE students do not necessarily receive CE 
in nfath; however, math CE students frequently also receive CE in reading. 

Each of the subtables in Table 4-4 provides data for examining the joint effects of instructional efforts 
in reading and math. The two-way analyses^/ variance for these data reveal very few noticeable 
main or interaction effects, and consequently \ve do not present the significant tests in the table. 
The lack of relationship between cost levels forVeading and math services and gains in practical 
achievement can be characterized by the small proportion of the variance in gain scores 
attributable c to the two cost factors. This proportion ranges between .6 to 1.2 percent across the 
measures of gains and the grades. ) 

Despite the absence of significant effects, the mean gain- - u ,vv some interesting patterns in the 
three grades In grade 4, the highest gains wer^ achieved by students who received services at the 
Highest cost levels in both reading and math. The relationship of marginal gains with effort in 
reading is non-monotonic, though slightly larger gains are attained at the highest cost level than at 
other levels. On the other hand, the marginal gains show a small, but monotonically increasing 
trend with increased effort in math. Furthermore, there is a tendency for PAS gains to be more 
spread out across levels of effort in math than in reading, suggesting that, at grade 4, the PA? may be 
more sensitive to differences in math services. 

In grade 5, there is not a clear trend in the relationship between effort and gain. Marginal mean 
gains are not monotonically plated to the levels of effort, differing insubstantially among the first 
three cost levels while showing a noticeable drop at the highest cost level. Although one is advised 
not to attach too much meaning to these patterns, the findings depart from our expectations. In 
grade 6, the marginal means for math cost levels show a similar departure from the monotonically 
increasing trend at the highest level as in grade 5. The relationship between marginal mean gains 
and reading cost levels is quite erratic, showing a zig-zag pattern. 

Conclusions. Considerations of sampling errors and the lack of consistent findings (similarities as 
well as differences) lead us to conclude that there is little direct relationship between growth in 
practical skills and cost levels for reading and math services. 
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Average Raw-Score Gains in Practical Achievement for CE Students, by Four Levels 
of Standard-Resource-DcHar Cost in Reading and Math 





Mctn 






Reading Cost Levels* 




G: ade 


Cost 

LcVelS* 




Low 


Low 
Average 


High 
Average 


High 


Total 


4 


Low 

Low Average 
High Average 
High 




3.92 
4.55 
2.95 
4.11 


3.46 
3,91 
4.31 
4.56 


3.49 
3.70 
4.54 
3.85 


4.67 
3.61 
4.51 
5.54 


3.76 
3.97 
4.31 
4.84 




Total 




4.23 


3.91 


3.93 


4.51 


4.07 


5 


Low Average 
High Average 
High 




2.76 
3.61 
3.53 
2.61 


, 3.23 
3.45 
3.45 


3.22 
3.31 
3.55 

"5 C.1 
J • 31 


1.64 
3.69 
4.23 
z . x / 


2.98 
3.46 
3.64 
2.59 




Total 




3.22 


3.37 


3.38 


3.23 


3.33 


6 


Low 

Low Average 
High Average 
High 




2.21 
3.00 
2.36 
3.46 


2.75 
3.00 
3.89 
3.12 


2.81 
3.30 
3.41 
2.88 


5.50 
3.13 
3.71 
2.89 


2.60 
3.08 
3.56 
2.95 




Total 




2.75 


3.15 


3.21 


3.21 


3.11 



Note: — Sample sizes can be found in Table D-22 of Appendix D. 

*The four cost levels for reading and math are defined in terms of the mean and 
standard deviation (s.d.) of the total resource costs of reading/math services 
for alO. CE students within each grade as follows: Low = one or more s.d. below 
the mean; I/3W Average = zero to one s.d. below the mean; High Average - zero to 
one s.d. above tne mean; and High ■ one or more s.d. above the mean. The lower 
end point of each level is excluded from that level. 



SUMMARY AND CONCLUSIONS 

The analyses presented in this chapter address the issue of a critical level of effort fo» ..arrowing the 
anticipated achievement gap between CE students and their educationally non-depnved peers. The 
purpose is to develop a model that conforms to a smooth and positive relationship between 
achievement growth and instructional fcffort, and to obtain, based on this model, an estimate of the 
level of effort that could be expected to raise the achievement of CE students to a level such that 
there is a meaningful.reduction of their achievement gap. 

Toward this end, linear and quadratic regression models were employed to examine the 
relationships between growth and effort. Four kinds of gain scores were used to measure the effects 
of instruction on growth, while the standard-resource-dollar cost for services was used to index the 
level of effort A decision-based theoretical approach was applied to determine, wherever possible, 
a threshold value of the standard-resource-dollar cost for services at which CE students would begin 
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to achieve an average gain greater than that expected of them in the absence of CE programs. The 

regression analyses produced little evidence for verifying the belief that achievement growth was a 

monotonically increasing function of instructional effort. As a result, we were not successful in prov 

ing the existence of a critical level of effort. 

♦ * 

Nevertheless, in order to better our understanding of the complex relationship between achieve- 
ment and instruction, we supplemented the theoretical approach by a number of descriptive 
analyses that explored the differences in patterns of instructional services received by CE students at 
different levels of effort and that studied the relationships^ growth with effort for different groups of 
students by kinds of CE program (Title I or Non-Title I) and by student characteristics. These analyses 
reveal that, as intended, CE programs have provided services associated with high costs (mostly 
instruction in small groups and sometimes by special teachers) to a greater number of educationally 
deprived students than regular programs; but services at high cost do not clearly result in greater 
growth. , * 

Only in a few occasions (notat ,y In grades 4 and 6 for matfi), positive relationships are consistently 
shown; and, even in such cases, the relationships are weak. Although in many other cases there is a 
small tendency for positive returns in the intermediate levels of effort, this trend is frequently inter- 
rupted by an observed drop of growth at the very high level of effort. We suspect that the ques- 
tionable efficiency of services at unusually high costs and the focus of higher-intensity services on 
lower-achieving students can hamper the normal effects of instructional effort on achievement. 

Reviewing the results discussed in this chapter, we conclude: 

• There is A enough evidence to support the concept of a 'critical level' of effort for narrow- 
ing the achievement gap between the disadvantaged and non-disadvantaged students. 

• At the present time, we are not optimistic that a universally positive and monotonic relation- 
ship between acadenic progress and level of effort will be established empirically in light of 
the state-of-the-art in the development of 'good' measures for growth and effort. 
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CHAPTER 5. THE EFFECTS OF COMPENSATORY SERVICES 

- AT DIFFERENT GRADES 
AND ON REPEATED PARTICIPATION 

c 

In this chapter, investigation of two important issues on the effects of CE are initiated with 
the cross-sectional data. The first concerns the best time to provide the services; that is, at 
what grades CE programs are more beneficial to the participants than at others. The 
second deals with the effects of repeated CE participation on achievement; that is, 
whether the history of participation, by itself, can influence the immediate effects ofCE 
services. 

Based on the cr6$s-*ectional data, the question of whether CE services are more beneficial 
at an earlier or later stage of schooling is answered by examining the differential effects of 
CE at elementary grades. The evaluation results in Chapter 2 are summarized iff terms of 
iour indexes for the growth of CE students (gains in vertical-scale scores, changes of 
percentile scores, and gains in excess of two different expectations derived from theperfor- 
mances of comparable non-CE students at CE and non-CE schools), and in reference to the 
respective indexes for needy non-CE students. We conclude from the cross-sectional 
analysis that, under current implementation, CE benefit: its participants relatively more at 
the earlier grades, particularly in reading. However, it must be noted that beneficial effects 
o f both reading and math CE are evident mostly in programs that receive funds from Title I 
(some may receive CE funds from other sources as well). CE students who participate in 
programs, that received support exclusively from non-Title I sources show an accelerated 
growth only infrequently. 

There are positive effects of reading CE primarily at the first three grades, and, in fact, it has 
little effect at grades 4 and 5. The results for math CE are slightly different: although it also 
has relatively larger effects at the lower grades (grades 1 and 3 specifically), there are no 
striking differences among the six grades. The relatively greatei effects at the earlier grades 
are not accompanied by relatively greater CE efforts. Based on these results, we conclude 
that compensatory services can help accelerate the achievement growth of disadvantaged 
students more efficiently at earlier grades than at later ones. 

c 

The ndture of the effects of repeated CE participation is studied by comparing the achieve- 
ment growth between two groups of current CE students who did and did not receive the 
services in the preceding year. Three hypotheses are formulated: the incremental effects, 
the diminishing effects, and the independent effecis. The results are inconclusive 
regarding the relative validity of these hypotheses. At some grades, it appears that 
repeatingparticipants gain more than the new participants, supporting the hypothesis of 
incremental effects. At others, the results appear to be the opposite, supporting the 
hypothesis of diminishing effects. The cross : sectional data, which tack accurate informa- 
tion on the entire history of students' CE participation, cannot provide a satisfactory 
resolution of tne issue. We hope that a better pizture of the effects of continued participa- 
tion will emerge from later analyses of the longitudinal data. 

In the preceding chapters, we examinr J ♦hc v achievement of CE students, comparing this with that 
of various groups of non-CE students d With statistical expectations, in order to evaluate the 
effects of CE programs. We alsp in v*stii i the relations of achievement gains to receipt of instruc- 
tional services to determine what kinci. amounts of services are required to raise the achieve- 
ment of CE students. There remain many other questions that can be addressed, at least partially, 
with the first-year data. Before we conclude Part I of this report, we take up two more issues. (1) Do 
the effects of CE programs differ among grades? and (2) Does the history of participation affect the 
achievement growth of current CE students? 

<> 

i 



The first-year data are by no means adequate for addressing these questions; nevertheless, we wish 
to explore the data so that useful information can be obtained to aid further inquiries. Our ultimate 
goal is to determine the best time to provide CE services, and how long they should continue. The 
answers to^these questions are basic to effective program implementation. For instancy if CE pro- 
grams have, greater effects on achievement growth at the earlier grades and the effects appear to 
diminish when the services are prolonged, school adm. istrators would be wise to emphasize com- 
pensatory services at earlier grades and to distribute the services to more low-achieving students by 
limiting the length of participation. 

In this chapter, the investigations of the long-term effects of CE are initiated with the first-year data. 
These investigations are intended to aid us in resolving the issue on how the effects of CE are related 
to the length and the pattern of participation. Full answers to this question will be provided in 
Report 14, wherp longitudinal data over a three-year span will be analyzed. 

In the first question, we ask whether compensatory education is more beneficial when received at 
some grades than ^at others. Because Title 1 prograrrfl have not been fully funded at the appropria- 
tions level, school .districts are not able to serve all their low-achieving students. Frequently, local 
administrators have; to decide on what grades (and what skill areas) to concentrate CE services. In 
making the choices^ they may consider not only the educational needs at different grades, but also 
the trade-off between services for one grade and the other in terms oi expected benefits for the 
educationally deprived students. It is possible that, since learning of complex skills at higher grades 
requires proficiency in elementary skills introduced earlier, CE services can be most helpful when 
provided at the early stages before the problems become serious and beyond remedy. Accord- 
ingly, we expect to sea greater effects at the lower grades. This expectation is reminiscent of a 
familiar dictum in medicine: early treatment brings greater hope of cure, while delay in treatment 
allows disease to grow out of control. A counter-argument, which finds no analog in medical treat- 
ment, is that at the beginning, the basic skills are simple to learn even for the disadvantaged 
students, so that additional assistance is hardly necessary and, if provided, would have little effect. 
Therefore, the effort could be saved for students in the upper grades who without special help are 
likely to lag behind. If this is the case, the effects of CE would be greater at the later grades. 

Which of these two situations is closer to the reality? In this chapter, we compare the effects of CE 
among grades on the basik of cross-sectional data in order to find an approximate answer to this 
question. The issue will be addressed again in two subsequent reports (Reports 12 and 14) which 
will study th e achievement patterns of the same students over three consecutive grades to provide a 
more accurate answer. Whether CE is more effective at one grade than at another is not simplelo 
determine. We cannot compare the effects of CE across the grades on equitable terms because the 
participants at different grades may suffer from different degrees and kinds of achievement deficits, 
and receive different amount^ of supplementary services. The effects ofCE could be greater at some 
grades because greater efforts have been invested or because the participants' learning problems 
are less severe or easier to overcome. A clear judgment on the differential effects of CE by grades 
would be impossible considering the uncontrollable nature of CE treatments. Being aware of this 
difficulty, we have confined our analysis to a narrower question: Under current practices, do CE 
students achieve more, relative to expectations, at some grades than at others? However, we will pro- 
vide the readers with contextual information regarding the differences in CE efforts among grades so 
that they can see the results of our analysis, in proper perspective. 

Our cross-sectional analysis reveals that CE programs appear to be more effective in improving 
achievement at the earlier grades. Under current implementation, the effects of CE tend to vary with 
grades more in reading than in math. The effects in reading are primarily in the first three grades; in 
math, the effects can be detectedjn almost all grades, though these effects are still more evident at 
the lower grades. However, based on the extent of increase in services over those received by 
educationally needy students who attend non-CE schools, it appears that proportionally more sup- 
plementary services are provided to CE students at the upper grades. Within this context, we think 
that greater efficiency of compensatory services can be achieved at earlier stages of schooling. 



1 7o 

142 



The second question deals with the long-term effects of CE, which is the primary concern of the Sus- 
taining Effects Study. The long-term effects can be examined in two directions. On the one hand, we 
are concerned about what happens to CE students when their compensatory services are discon- 
tinued because of their improved achievement. Do they fall back to their earlier low-achievement 
status, suggesting that the effects of CE are ephemeral; or do they maintain the improved status, 
showing that the effects are long-lasting? This question is addressed in Report 11 which examines 
the achievement pattern of fQrmer CE students who no longer receive the services. The report con- 
cluded th^t there was little evidence for dissipation } of CE effects after discontinuation of services. 
This issue will be examined further in Report 15 with the three-year sample. 

On the other hand, it is important for us to know whether CE programs remain beneficial for the 
students who participate year after year. One hypothesis in this regard is thai the low-achieving 
students will achieve substantially better during their first year of participation, but that continued 
participation in subsequent years*Will not further the improvement much. There are many parallel 
phenomena 6f diminishing effects, as in medicine and economics. An example in medicine is that 
when a dose of^a drug (e.g., a tranquilizer or*an antibiotic) is prescribed for a patient, it relieves the 
treated symptoms the first time; however, if the problem persists for a period or reoccurs later, ii^ 
creasingly larger do: .'ges are required subsequently to give the same relief (indicating a diminishing 
effect of the treatment), or, worse, the drug fails to helq altogether (indicating a one-shot effect). 
This example deals with the effect of continuing the same treatment for a patient. A cross-sectional 
example would be that the same treatment brings less (or noMrelief of the problems for patients who 
have received it before than for those who have not. For convenience, we will refer to this 
phenomenon as the hypothesis of diminishing or one-shot effects. 

A second possibility is that the low-achieving students are so severely disadvantaged, they will not 
benefit from the supplementary services immediately, but the earlier services may have some 
delayed effects which serve to enhance the effects of subsequent services. As a result, an extended 
period of help may be required in order to achieve substantial progress, and the effects would 
increase with length of services. Examples of incremental effects are also common in medicine, 
economics, and other fields. 

A third possibility is that the program effect at each yfear of participation is independent of the child's 
previous experience. Every time a child receives additional help, he benefits from ft in the same way 
as he did earlier (whether or not the effects eventually accumulate is not pertinent to the dis- 
tinctness of th h possibility). In the medical analog, each dosage of a drug is expected to produce the 
same effect regardless of whether it has been used before. This third case will be called the 
hypothesis of independent effects. 

Knowledge of which of the three hypotheses is correct can affect policies of student selection and 
allocation of services in compensatory programs. If the effect of CE is mostly realized at the first time 
of participation, and the funds are not sufficient to serve all deprived children in a single year, the 
eligible students may alternate participation in different years. Conversely, if the effect is incremen- 
tal, we may want to errphasize long-term services for the most needy instead of intermittent ser- 
vices for all needy. In the third case, where previous experience does not influence the result of cur- 
rent'participation, emphasis may be placed on certain grades when the programs are expected to 
be most effective. 

1 " * 

The relative validities of the alternative hypotheses are, therefore, of interest to us. An ideal design 
for testing these hypotheses would include three random groups of educationally needy students; 
the first group, Gq, will not receive any CE services for two consecutive years, the second, d, will 
receive the services in the second year only; while the third, G2, will receive the services in both 
years. The achievement progress of each of the three groups would be followed for the two years, 
and their achievement patterns would be compared to determine which of the three situations is 
best reflected in the data. Table 5-1 illustrates such a design and Figure 5-1 explains the results that 
could be expected«under each of the different hypotheses. . I 
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(a) Achievement Gains in the first 
year, showing a positive 
effect of CE. 
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(b) Achievement Gains in the • 
second year, showing an 
incremental effect of CE 
with continued participation. 
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(c) Achievement gains in the second 
year, showing an independent 
effect of CE with continued 
participation. 
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Achievement gains in the second 
year, showing a diminishing 
effect of £E with continued 
participation. 



Note. — Group G 0 received no CE services in either year; Group received 
CE in the second year; and Group G 2 received CE in both years. 

Figure 5-1 

- Expected Achievement Cains for Three Hypothetical Groups of 
Students Having Different Histories of CE Participation 
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Table 5-1 



An Ideal Design for a Two-Year Evaluation for Assessing 
the Effects of Repeated Participation in CE Programs 



Receipt of CE Services 



Group 



First Year 



Second Year 




NO 



NO 



NO 



Yes 



Yes 



Yes 



/ 



In part (a) of Figure 5-1, a positive effect of CE is verified by the larger achievement gain in the first 
year for group G2, which received CE in that year, than for the other two groups that did not receive 
the services that year, Part (b) shows the hypothetical results under the assumption of incremental 
effects of continued CE participation. There, the rank orders for the groups with respect to the 
average gain m the second year are, from large to small, C2, G1, Go- Under the hypothesis of 
independent effects, the average gains would demonstrate the rank orders represented in part (c); 
G2 and G1 achieve similar gains in the second year, but Go has a smaller gain. Finally, suppose 
repeated participation causes the effects of CE to diminish. We would expect the results shown in 
part (d); in the second year, both G1 and G2 gain more than Go, and G2/ having participated for the 
second year, gains less than G1, the new participants. 

Thus, if this ideal design were feasible, we would be able to resolve the issue with ease, unless the 
actual situation is more complex than what we have described so far. As an example, it is con- 
ceivable that the effects of CE might be incremental over a certain period of continued participation 
and then begin to diminish with further participation.; In such a case, more than two years of data 
would probably oe required to reveal the phenomenon. Clearly, the data employed in this report 
do not afford us a thorough analysis for either the simpler or the more complex cases. 

For the present analysis, we only have one year of achievement data, and participation records are 
obtained only for the 1976-77 school year. In order to approximate the design shown in Table 5-1, 
we have to use retrospective information on student receipt of CE in preceding year (1975-76), as 
reported by homeroom teachers. The accuracy of such data, however, may be in question as sug- 
gested by the teachers' inabilities to identify correctly the current CE students (see Report 5 and later 
discussions in this chapter). Another problem fc that the two groups of current CE students who did 
not participate in the previous year are likely to be non-equivalent with respect to ability and 
backgrounds. Although some pre-existing differences can be adjusted statistically, their con- 
founding effects in the comparison of achievement growth between groups cannot be removed 
totally. The imperfection of our data for evaluating the hypotheses on the effects of repeated CE par- 
ticipation is further underscored by *he differences in supplementary services received by the 
groups. Without complete control for these diherences, it would be difficult to prove that repetition 
of participation can or cannot, by itself, influence the effects of C£. 

Despite these difficulties, we decided to compare the achievement between two groups of CE 
students in 1976-77 who did and did not receive the services in 1975-76, as a partial investigation of 
th^e long-term effects of CE. With our approach, we remind the reader that the immediate effects of 
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CE in 1975-76 cannot be verified (as in part (a) of Figure 5-1) because we do not have achievement 
data for that year. Nevertheless, these missing data do not deny us the opportunity to uncover 
useful information regarding the issue of the effects of repeated CE participation. 

As explained in parts (b), (c), and (d) of Figure 5-1, the relative validities of the three competing 
hypotheses can be assessed primarily by the relative gains in the second year between the CE 
students with and without previous participation in the first year (that is C-\ and G2 in our idealized 
design). Therefore, our comparisons will concentrate on these two groups of current Cj: students 
and omit the group of non-CE students (i.f\, Gq in Table 5-1). As necessary, the achievement gains 
need to be adjusted for pre-existing differences so as to alleviate their confounding effects. 

In summary, the second question whifh concerns the long-term effects of CE will be answered by 
examining the achievement growth of two groups of current CE students. If the students vyho repeat 
participation in a successive year show greater growth than the new participants, the data favor the 
hypothesis of incremental effects. On the other hand, if, ceteris paribus, the 'first-time' participants 
benefit from the current services more than the repeaters, the data support the hypothesis of 
diminishing or one-shot effects. In the event that there are no differences between the two groups, 
the hypothesis of independent effects is supported. 

Because the function of CE programs is to provide additional instruction to the participants, the 
long-term effects of CE cannot be meaningfully examined without consideration of the different 
instructional services received by the students. Suppose that the new participants received services 
that are different from those received by the repeaters; we need not expect them to benefit equally 
from the programs even if the effects of current services are not influenced by participation history. 
Thus, it is important that, in our analyses, we explore various methods to take into account the 
effects of instructional services so that proper tests of the hypotheses are insured. For this reason, 
instructional service constitutes an important factor in the analyses to be discussed later. 

The results of our analysis are mixed: the data at different grades and for different skill areas appear 
to support different hypotheses. For both reading and math, thedata in grades 1 and 3 tend to favor 
the hypotheses of incremental effects as participation continues in a successive year. On the other 
hand, there is some evidence that the beneficial effects of CE may be diminishing for the students 
who repeatedly receive the services. Such diminishing effects may be suspected on the basis of the 
data in grade 5 for math. The inconclusive findings are somewhat disturbing and the issue awaits 
further clarification, j 

DIFFERENTIAL EFFECTS OF CE BY GRADES 

/in Chapter 2, we employed an array of comparison standards to assess the effects of CE at each 
grade. Except for some occasional remarks, the question of whether CE has greater effects at some 
grades than at others was not addressed explicitly. We now review and reorganize the results in that 
chapter in order to deal with this issue formally. 

Because the achievement process at each grade need not be identical, the growth curve over the 
elementary grades may be nonlinear, as suggested by the cross-sectional data plotted in Figures 1-1 
and 1-2 of Report 9. Similar nonlinear trends may also be suggested by the data presented in Figures 
2-2 and 2-3 of Chapter 2. This nonlinear trend indicates that, in terms of vertical scale scores (VSS), 
the achievement gains for the same students may differ substantially as they progress through the 
grades. If this were the case, it would be inappropriate to compare the relative effects of CE directly 
in terms of increased VSS gains over the expectations among different grades. 

One way to overcome this difficulty is to choose a common frame of reference for all grades and 
express the gains relative to the respective reference for the purpose of comparisons. Following this 
strategy, we express the average VSS gain for CE students as a percentage of the gain fo" a typical 
performer at the same grade (that is, the VSS gain for the 50th percentile in the achievement norm). 
The percentages at different grades can then ')e compared to determine if CE students make propor- 
tionally larger gams at some grades than at others. With similar considerations, the residual gains 
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(observed min us expected posttest scores), which were also used in our earlier evaluation of CE pro- 
grams, were transformed into percentages of the expected scores. In this way, we can compare the 
effects of CE among grades in terms of proportional improvements relative to the corresponding 
expectations. 

For the fourth index of achievement growth, the z-score gain, which was also used in our previous 
analyses, we present simply the percentile scores at both pretest and posttest administrations to 
show the pattern of changing statuses for the CE students. At any grade, it is intuitively plausible to 
assume that students will maintain the same percentiles (i.e., have a z-score gain equal to zero) in 
the normal educational process, unless there are special interventions. The extent to which the 
achievement of CE students surpasses or falls below this expectation can be gauged in a straight- 
forward manner by the rise or fall of their average percentile rank at the end of the school year; and 
there is little need to devise a special index for the comparisons among grades. 

Thus, the findings in Chapter 2 are summarized by grades in Appendix E (see Table E-1 for reading 
and Table E-2 for math) either in terms of the relative indexes or the actual data at pretest and post- 
test. In these summaries, we present the data not only for the different groups of CE students (Title I 
students, Other-CE students in Title I schools, and CE students in non-Title I schools) but also for two 
groups of students who were judged to have need for CE but did not receive the services, either 
because their schools did not offer CE or because funds were not sufficient to extend services to 
them. 

The data for these two comparison groups of non-CE students are added to the tables in order to 
provide a further basis for judging the relative effects of CE over grades. These data are especially 
valuable when the index for VSS gain is u*ed. !n the natural course of learning, educationally 
deprived students can lose (or even gain) ground to the normal students by relatively different 
amounts at different grades. These differences among grades can result from the different paths of 
maturation for the disadvantaged and regular students. In particular, such differences can arise 
artifactually as a result of employing achievement tests that fail to measure properly the whole range 
of skills learned by different kinds of students at each grade. 

In the case of residual gains, the relative index is not obviously affected by the different maturation 
processes for students with different backgrounds, as such differences have been taken into account 
in the statistical models that generate the expectations. Nevertheless, the data for needy non-CE 
students are compiled to allow us to check further the utility of the prediction models that are 
developed on the basis of data for all non-CE students. In order for the models to be useful, they 
must accurately predict the achievement of educationally needy students who did not receive CE; 
otherwise, we cannot be confident of the appropriateness of residual gains as measures of the 
effects of CE. 

Similarly, the pretest and posttest percentile scores for the needy non-CE students are examined in 
order to assess the validity of the percentile-maintenance expectation. In addition, these data can 
reveal possibly different changes of achievement status for the deprived students at different grades 
when there is no CE. Such differences need be considered when we compare the effects of CE 
among grades. 

In what follows, we will examine the data presented in Tables E-1 and E-2 to shed light on the issue 
concerning the differential effects of CE according to grades. 

The Effects of Reading CE by Grade. Table E-1 of Appendix E presents the summary data for reading 
achievement. Based on the average percentile scores, we find that, among CE students, onlv Title I 
students consistently show an improvement of their achievement standings at posttest. The increase 
in percentile scores achieved by Title I students is the largest at grade 3, and the second largest at 
grade 4. However, at both of these grades, needy non-CE students also shov an improvement of 
their status so that we are not certain that the increase for Title I students is entirely attributable to 
their participation in CE. 
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Indeed, the validity of the percentile-maintenance expectation appears to vary with grades when it 
is applied to the achievement of educationally needy students. For this reason, it would be more 
appropriate to base our judgment, regarding the relative effects of CE, on the difference in percen- 
tile changes between CE and needy non-CE students at each grade. To facilitate the comparisons, 
the pretest and posttest percentile scores of Title I students and students in non-CE schools who 
were judged to have need for CE are plotted in Figure 5-2 by grades. The slope of the line segment 
that connects the pretest and posttest scores of the same group indicates the direction and 
magnitude of the percentile change for that group. A positive slope shows an improved status, while 
a negative slope shows a deteriorated status; and the steeper the slope, the greater the change of 
status. 

From these plots, we see that, with the performance of the needy non-CE students as a reference 
base, the improvement of Title I students is more pronounced at the first three grades than at others. 
This result is consistent with that of the Compensatory Reading Study (Trismen et al., 1975), which 
found CE in reading to be more effective in grade 2 than in grades 4 and 6. Additionally, we note 
that, at most grades (grades 1 and 2 in particular), the comfparison non-CE group falls further behind 
at the end of the school year, suggesting that they have needs for special assistance to curb such 
decline. to j. 

Could the greater effects of Title I at the earlier grades chiefly result from greater efforts? To explore 
this possibility, we present in Table 5-2 the total instructional services received by these t wo groups 
of students, and compare the program efforts at different grades in terms of percent of increased ser- 
vices for Title I students over those received by ed ucationally needy students at non-CE schools. The 
data reveal that supplementary' services received by Title I itudents are proportionally greater at 
the upper three grades. Thus we believe that the relatively greater effects of Title I at the lower 
grades suggest that earlier help is more beneficial, perhaps oecause it is provided in time. 



Table 5-2. 

Comparisons of Reading and Math Services Received by Title I 
Students and Non-CE Students at Non-CE Schools Who Were 
Judged To Have Need for CE by Their Teachers 



Reading Services Received Math Services Received 



Needy Non-CE % Increase Needy Non-CE % Increase 

Title I * St :dents at for Title I Title I Students at for Title I 

Students Non-CE Schools Students* Students Non-CF Schools Students* 



Hours of Instruction Per Year 



1 


316 


5 


310.4 


2.0 


170.9 


172.3 


-0.8 


2 


298 


1 


255.2 


16.8 


17*9.7 


161.0 


11.6 


3 


272 


1 


259.8 


4.7 


186.5 


174.8 


6.7 


4 


248 


7 


197.? 


26.1 


198.5 


169.8 


16.9 


5 


227 


4 


189.9 


19.7 


202.1 


163.8 


19.0 


6 


226 


5 


190.3 


19.0 


188.8 


174.3 


8.3 








Standard- 


-Resource-Dollar Costs 


for Instruction Per Year 




1 


428 


7 


339.5 


26.3 


203.0 


144.3 


40.9 


2 


428 


4 


297.8 


43.9 


198.8 


13 r .0 


47.3 


3 


392 


3 


305.2 


28.5 


228.4 


15U. r 


51.8 


4 


384 


4 


226.2 


69.9 


, 255.0 


149.1 


71.0 


5 


333 


8 


219.8 


51.9 


260.0 


158.8 


63.7 


6 


336' 


9^ 


207.8 


62.1 


241.3 


176 3 


36.9 



*Percent of increase for Title I students is" obtained with services received by needy 
non-CE students at non-CE schools as the reference base. 
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By comparison, there is little evidence that there are differential effects of non-Title I CE programs at 
elementary grades. We remind the reader that in fact these Other-CE programs appear to have little 
overall effect on the achievement of their participants who do not also receive Title I services. 

With respect to other indexes, the same conclusions, indicating larger effects at earlier grades, can 
be generally reached with proper comparisons. Hence, we will not repeat the discussion here; the 
interested reader may study the data in Table E-1. 

Before we discuss the findings in math, there are a few additional results which, while not address- 
ing the issue directly, are worth noting: the first concerns the growth rate of educationally deprived 
students; the second and the third deal with the usefulness of statistical models in the evaluation of 
CE effects. 

• In terms of VSS gain, both groups of needy non-CE st udents {at C E and non-CE schools) con- 
sistently grow at a rate below that of the median performers (the hypothetical students who 
perform at the 50th percentile). The only exception is found at grade 4 where tjjese students 
grow at a slightly higher rate than that of a typical student. Although Titfe>f1tudents (and 
occasionally Other-CE students) exhibit a faster rate of growth than that of these comparison 
non-CE students, they still grow at a slower rate than the 'median' students. Thus, the cross- 
sectional data suggest that, in an absolute sense, the achievement gap between the disadvan- 
taged and non-disadvantaged students tends to increase with grades. Where there are 
positive effects, Title I programs help in reducing this increasing gap. 

• In most cases, the prediction model developed on the basis of data for students at non-CE 
schools (the Model A described in Appendix B5) can estimate very well the posUest perfor- 
mance of needy non-CE students at these schools. (For a perfect prediction, the relative 
index with respect to Residual Cain A in Table E-1 would be 100 for this group.) The satisfac- 
tory validation of the model with the actual performance of this special group of students 
adds to our confidence of using the model to generate the expectations of CE student perfor- 
mance under no-CE situations. 

• The prediction model calibrated with the data for non-CE students at CE schools (the Mode! 
B described in Appendix B5) frequently underestimates the actual performance of the needy 
non-CE students at these schools. Such bias in predicting the achievement of educationally 
needy students could partly be explained by the truncation of data in the low-score range as 
a result of excluding the data for CE students. This exclusion of data is necessitated^ the 
desire to separate the effects of CE from regular achievement growth. The strategy, h6wever, 
appears to result in the model's inability to provide accurate expectations for the low- 
achieving students; this deficiency clearly reduces the value X)f the model in judging the 
effects of CE. 

For the matjj data presented in Table E-2 of Appendix E, we also arrive at similar findings. Therefore, 
the discussion of these results for math will not be repeated in the next section. 

The Effects of Math CE by Grade. The summary data for math achievement are presented in Table 
E-2 of Appendix E. On the whole, similar conclusions can be obtained with respect to different 
indexes of the effects. We will therefore discuss only the results based on percentile scores since 
they are the easiest to understand. The reader is referred to Table E-2 for detailed information. 

Ao in reading, the average percentile score of Title I students rises frofn pretest to posttest at all 
grades, whereas that for other-CE students tends to drop or remain the same. "I he two groups of 
needy non-CE students also show a decrease at the posttest. The change of status by the comparison 
non-CE students varies with grades, suggesting that the validity of the percentile-maintenance 
expectation may differ among grades. For th is reason, we take into consideration the progress of the 
comparison non-CE students when comparing the relative effects of CE among grades. 
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In Figure 5-2, we present the average pretest and posttest percentile scores of Title I students and 
students judged to have need for math CE but attending non-CE schools. The graphs can be 
examined in the same way as explained earlier in conjunction with the reading data. From these 
graphs, we find that the effects of CE on the achievement of Title I students are relatively larger at the 
lower grades; however, these relative effects do not differ among grades as much as in reading. The 
improvement made by Title I students is the.largest at grades 1 and 3; but at the remaining grades, 
Title I students also show noticeable improvements. 

In order to see how the effects of CE may relate to program efforts, we show in Table 5-2 the percen- 
tages of increased math services received by Title I students, in reference to the services received by 
needy non-CE students at non-CE schools. The data in this table suggest that proportionally more 
additional services are extended to Title I students at grades 4 and 5. Thus, the data do not reveal a 
positive association between relative efforts and effects. Possibly because of the increasingly difficult 
learning materials that require comparatively more instruction for low-achieving students to master, 
the schools have decided to invest greater efforts at the upper grades. As a result, the relative effects 
at different grades do not necessarily reflect the existing efforts. 

. Clearly, ti issue of differential effects by grades is a very difficult one to settle in view of the com- 
plex relationship between needs and efforts. While acknowledging this problem, we still think that 
„the larger relative effects at earlier grades confirm our intuitive belief that educationally deprived 
students are more likely to benefit from earlierremedy. 

Conclusions. Using different indexes for the effects of CE and taking into account the achievement 
progress of educationally needy students who do not receive CE, we find that there are some dif- 
ferential effects of CE by grades. In reading, the effects are relatively larger at the first three grades; 
and, in fact, there is little effect at grades 4 and 5. By comparison, the differential effects of math CE 
are not as pronounced. Although the relative effects of math CE are still greater at the lower grades 
(grades 1 and 3, in particular), there is evidence for a positive effect at every grade and the dif- 
ferences among grades are not large. 

In both reading and r.ath, the relative effects of CE do noc have a positive relationship with the 
relative efforts at different grades. In terms of percent of increased services received by Title I 
students, as compared w.th the services for needy students at non-CE schools, the program efforts 
tend to be greater at the upper grades. We conclude from our analysis that, with comparable 
efforts, CE is likely to benefit its participants more when provided at the ea r !ier stages of schooling. 

Finally, we should note that the programs that consistently show positive e.'fects are usually sup- 
ported by Title I, and sometimes also by other-CE funds. However, the programs that receive only 
non-Title I support tend to have little effect. The diverse objectives of other-CE programs could 
probably explain these differential effects between Title I and non-Title I programs. 

THE EFFECTS OF REPEATED CE PARTICIPATION 

As exp'ained in the opening df this chapter, th ■ alternative hypotheses about the effects of repeated 
CE participation will be tested primarily by examining the achievement of CE students who have dif- 
ferent histories of participation. We remind the reader that because of the limitation to a single year 
of data, we can only address three simple hypotheses; we will leave considerations of the more 
complex longitudinal hypotheses to subsequent reports. 

The three competing hypotheses to be considered here are: the hypothesis of incremental effects, 
the hypothesis of diminishing effects, and the hypothesis of independent effects. 

First, we will introduce the evaluation design that includes a major factor— history of CE participa- 
tion, and a control factor-receipt of instructional services. Three kinds of gain scores will be ana- 
lyzed with this design, each representing a different way to account for the influence of ability and 
backgrounds on normal growth. Second, we will discuss the differences, with respect to pretest 
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achievement and receipt erf instruction. This supplemental information is provided to assist in the 
proper interpretation of the results Thirtf, the results of the analysis will be discussed in terms of the 
effects of continued CE participation. v> 

Evaluation Design i 

The evaluation design is explained in three parts: (1) a description of student grouping on the basis 
of participation history during the period of 1975-1977 school years; {2} a description of various 
methods for adjusting for the confounding effects of instructional services; and (3) a description' of 
the dependent measures to be analyzed. ■ > 

Student Grouping. The primary factor in the design is the student participation pattern in the school 
years 1975-76 and 1 976-77. Following the layout in Table 5-1 , our interest centers on two groups of 
''current' CE students (participating in 1976-77) who did and did not receive CE in the preceding 
year (1975-76). 

Student CE status in 1976-77 can be reasonably ascertained from the Compensatory Education 
Roster (CER) in which school coordinators recorded each student's participation in five different CE 
programs. For 1975-76, student CE receipt can only be determined from the retrospective reports by 
homeroom teachers. In the Student Background Checklist (SBC), teachers were asked to indicate 
whether their students received CE in 1975-76 and in 1976-77 The duplicated data for 1976-1977 
(from CER and SBC) allow us to verify the teacher's ability to identify the CE students correctly. 

In this regard, previous analyses (see Tables 3-29 and 3-30 of Report 5) revealed that teachers were 
not aware of the CE participation of a considerable number of students. For these students, we have 
some reason to suspect that their teachers may also be unable to provide accurate information 
about whether they received CE in 1975-76 because their teachers are probably unfamiliar with 
their educational records. Accordingly, we decided to separate these CE students from the others to 
form r. third group. 

As wii! be seen later, the group of CE students who are not so identified by their teachers tends to 
achieve better at the pretest and receives less services than those whose teachers have knowledge 
of their participation. This finding suggests that the third group of CE students may inadvertently 
miss some benefits of CE services because their teachers do not recognize their CE status and thus 
fail to provide them the intended special assistance. The separation of these 'misidentified' CE 
x studer«ts into a distinct group can sharpen our analysis; as a result, more sensitive tests of the 
hypotheses may be accomplished. 

In summary, CE students were divided into three groups (instead of tv.o as originally planned) in 
terms of their participation records for two consecutive school years. Note that, for brevity, v-E 
students are those who received CE in 1976-17 according to the CER data, 

• Repeated Participants. CE students whose teachers reported that tl.ey received CE in both 
1975-76 and 1976-77. 

• New Part/c/pants. CE students whose teachers reported that they received CE in 1976-77, but 
not in 1975-76. (We call these students 'new' participants in crder to differentiate them from 
those who also participated in the preceding year; however, they could have received CE in 
years prior to 1975, especially those at the upper grades.) 

• Misidentified Participants. CE students whose teachers reported that they did not receive CE 
in 1976-77 (regardless of whether they received it in 1975-76 or not). 

At this point, we should remark that because we can only trace the history of participation for two 
years, the analysis will not capture the total influence o,f previous receipt on the immediate effects of 
current services. This problem is particularly serious at the higher grades where students can have 
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more complicated patterns of participation. For instance, a student may enter the CE program in 
one year, leave it in another, and then return to it in the third. 

More important, because the selection of students to participate in CE is a dynamic process in which 
the lowest-achieving and lowest-growth students are the most likely to remain in the program 
longer, there are numerous threats to the validity of the comparison between groups of students 
with different histories of CE receipt. Specifically, these groups of students are not equivalent with 
respect to other achievement-related factors such as amount of services received, ability, and home 
environment. In what follows, we will explain how these threats may be lessened by controlling for 
service differences and by using indexes of growth that adjust for preexisting differences in ability 
arid background characteristics. Nevertheless, statistical controls and adjustments are rarely ade- 
quate to solve the problem of non-equivalence completely. 

Considering these difficulties, we emphatically forewarn the reader not to draw hasty conclusions 
from the results. Our analysis aims at adding to our knowledge with regard to the long-term effect of 
CE. It is a complex issue, and each in/estigation based on data over a truncated period of the entire 
education process is not expected to resolve it. 

Adjusting for Differences in Receipt of Instruction^ Services. The three groups of Cl students may 
receive different kinds and amounts of instructional services that can affect achievement growth. 
Therefore, in order to understand the effect of repeated participation per se, we need to separate 
the confounding effect of instruction from the total effect of participation history. Three methods are 
employed to adjust for the instructional differences among the groups. 

In the first method, we enter 'type of services received' into the design as a second factor so that the 
effect of participation history can be evaluated with adjustment for the instructional effect. Because 
CE services are characterized by special kinds of services, we propose to classify the instructional 
services into two major categories: 'special' and 'non-special'. The special category includes 
instruction by classroom teachers in groups of six students or less, instruction by special teachers, 
and assistance by paid aides/assistants. The non-special category includes instruction by classroom 
teachers in groups of seven students or more, and work with tutors or independently. Earlier 
analyses (see Chapter 3) indicate that services for CE students are increased primarily in the category 
of special instruction, which is also likely to differentiate the services between different groups of CE 
students. Additionally, the two categories of instruction appear to have different relationships with 
achievement growth. Thus, the distinction between special and non-special services could be useful 
for the purpose of controlling for instructional differences. 

The annual receipt of instruction in each of the two categories is dichotomized at the respective 
population mean (see Table E-3 of Appendix E) to differentiate the services received by the students. 
Thus, four types of instructional services are defined jointly on the basis of the two dichotomies; 
each group of CE students is accordingly subdivided into four groups corresponding to these four 
types of services. 

• High/High Croup: Students who received an above-averag? amount of special instruction 
and an above-average amount of non-special instruction. 

• High/Low C/feup. Students who received an above-average amoun. of special instruction, 
but a below-average amount of non-special instruction. 

• Low/High Croup: Students who received a below-average amount of special instruction, but 
an above-average amount of non-special instruction. 

• Low/Low Croup. Studerits who received a below-average amount of special instruction, and 
a below-average amount of non-special instruction. 

Although the four types of services are discrete, they are partially ordered with respect to total 
amount. and intensity of services. The High/High group receives services that are generally of 



greatest amount and highest intensity, in comparison with the other three groups. The services 
received by the Low/Low group tend to be in the smallest amount and the least intensive. On the 
average, the High/Low and Low/High groups receive a similar amount of services but the High/Low 
group receives more intensive services. 

With this design, t we employ the technique of analysis of variance (ANOVA) to assess the effects of 
participation history, while the effects of instructional services are statistically controlled. Addi- 
tionally,, we can examine, in this context, the interaction between the two factors, participation 
history and type of services. A substantial interaction-effect could suggest that repeated CE par- 
ticipation can have different influences on achievement growth, depending on the type of services 
provided. 

The second method uses an analysis-of-covariance (ANCOVA) approach. The discrete type of ser- 
vices would be "an appropriate contro 1 factor if it could capture the total relationship between ser- 
vices and growth. In reality, the relationship is complex and unknown to us. For this reason, it is 
important that we explore other ways of adjustment also. 

As an alternative, the instructional differences may be adjusted for based on the assumption that 
growth and services are linearly related. Such relationships were assumed when we examined the 
effects of instructional services on achievement in Chapter 3, There, the instructional services were 
described by three composites: Hs, hours of special instruction; Hr, hours of regular instruction; 
and Hf, hours of work with tutors or independently. (Note that now the category of non-specia^ a 
instruction in the preceding method is split into Hr, and H\. For the rationale of constructing these 
composites, the reader is referred to Chapter 3.) Similarly, we propose to use these same com- . 
positesas the covariates to adjust for instructional differences in the present analysis, in this way, the 
adjusted means for achievement growth are compared among the three groups of CE students to 
determine the effects of participation history. 

In the third method of adjustment, a different measure of instructional services is used. So far we 
have considered only number of hours as the measure of instructional services received. Because 
the time measure does not reflect the intensity of services, we separately measured the instruction 
in settings of different labor-intensity (e.g., special vs. non-special instiuction). An alternative 
measure that takes both the quantity and intensity of services into account is the Standard- 
Resource-Dollar cost for services. This cost measure reflects the labor-intensity of services by assign- 
ing higher cost to more intensive instruction (see descriptions in Chapter 3). In order to see if adjust- 
ments based on different measuies of services yield different results, we propose to use the 
Standard-Resource-Dollar cost as the measure of instructional services in the jhird approach; 

The same measure has been used in Chapter 4 to investigate the relationships between instructional 
effort and achievement growth. There we found that such relationships could be examined more 
' clearly by dividing services into discrete levels of effort than by regression models. Therefore, the 
adjustment for instructional differences as measured by the Standard-Resource-Dollar cost is 
accomplished by introducing into the analysis a second factor that comprises four levels of instruc- 
tional effort. As defined in Chapter 4, the four levels of effort are: 

High. The Standard-Resource-Dollar cost for total services exceeds the mean cost for all CE 
students by at least one standard deviation. 

High Average. The Standard-Resource-DoNar cost for total services exceeds the mean cost for 
all CE students by less than one standard deviation. 

Low Average. The Standard-Resource-Dollar cost for total services falls below the mean cost 
for all CE students by less than one standard deviation. 

Low. The Standard-Resource-Dollar cost for total services falls below the mean cost for all CE 
students by at least one standard' deviation. 
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t According!/, each group of CE students is subdivided mto fou r groups by the levetof effort that 
represerS the services it receives. 

Thus, the third method is similar to the first except that the level of instructional effort replaces the 
type of services as the control factor. The history of participation remains the primary factor in the 
design. Again, the effect of repeated CE participation can be evaluated conditional on the level of 
effort,, whether the effect of participation history varies with the level of effort can be determined by 
the interaction between the two factors. 

In nummary, the three methods for removing the confounding effects of instructional services are: 

• Use of types of services as a cofactor. 

• Use of three service composites as covariates. 

• Use of level of effort as a cofactor. 

Dependent Measures To Be Analyzed. With each method of analysis, thre? indexes of achievement 
growth are 0 exarr : ned: 

• Z-Score Gam. Z-score at posttest minus that at pretest, where Z score is il.e standardized nor- 
mal deviate associated with the percentile score. 

• Residual Gam A. Observed posttest Vertical Scale Score (VSS) minus the expectation, where 
the expectation is set by a prediction model developed on the basis of data for all students 
attending non-CE schools. The predictors used are pretest score and background 
characteristics. 

• Residual Gain B. Similar to Residual Gain A, but the prediction model is developed on the 
basis of data for non-CE students attending CE schools. (See Appendix B5 for detailed 
descriptions of the residual gains.) 

Eacti of the gain scores represents a different way of adjusting for pre-existing differences among the 
groups. The VSS gain is not considered because the differential pretest achievement and growth rate 
are more likely to threaten the validity of the analysis based on it. Preliminary analyses, however, 
suggest that the results based on VSS gains are not contradictory to those obtained with the three 
indexes listed above. 

In addition, the pretest scores are analyzed with similar designs to examine tfie initial acfrifevepient 
differences among groups of students who have different histories of CE participation and received 
different types or leveh of services. We ^re interested in learning how achievement status may affect 
the pattern of CE participation. Moreover, the pretest differences among the groups can aid us in 
interpreting the r^ults of analysis on gain scores. 

Group Differences in Pretest Achievement and Receipt of Services 

!n view of the selection policy of CE programs, it is reasonable to expect students having different 
histories of participation to differ with respect to achievement. It is also conceivable that CE students 
are provided different amounts of supplementary services according to their needs. For instance, 
there is some evidence that amount of services received correlates negatively with achievement 
(see Chapter 3). Accordingly, we may expect the long-term and the short-term CE students tiQ the 
present case, the repeated and the new participants) to receive different serviies because of their 
different needs. Before we examine the effects of repeated CE participation, it is useful to present 
some findings in these regards in order to further our understanding of the CE process. Foi conve- 
nience, we will discuss the findings for reading and math separately. 



155 18'J 



/ 



Reading Achievement and Serv/ces. The results of the ANOVAs for reading pretest scores are sum- 
marized in Appendix E. In Table E-4, the analysis involves two crossed factors, participation history 
by type of services; whereas in Table E-5, the second factor is replaced with level of effort. We will 
discuss only highlights of the findings below; for details, the reader may study the tables in the 
Appendix.^ 

In Figure 5-3, we plot the average pretest scores for the three groups of CE students by grade. The 
figure clearly shows that, at the pretest, the misidentified participants (labeled as 'uncertain' in the 
figure) achieve substantially better than the others. This result suggests that there is a tendency for 
teachers to associate student'* CE status with achievement; they have difficulties identifying the par- 
ticipants who achieve above the typical level for CE students. This conjecture is supported by the 
finding in Report 5 that these misidentifiediEE students are also judged to have no need for CE by 
the same teachers. / 



By comparison, the achievement differences between the repeated participants (participating in 
both years) and the new participants (participating in 1976-77 only) are generally small, though the 
latter tend to have slightly higher pretest scores. We suspect that this is a result of CE selection prac- 
tices. The borderline achievers in a previous year (those who achieved just slightly above the selec- 
tion criterion) may become participants in the following year as replacements for the earlier CE 
students who have been disqualified because of improved status. At the same time, the lowest- 
achieving students are the most likely to remain as participants in successive years. Consequently, 
the short-term participants are less disadvantaged and achieve better relative to the long-term par- 
* » ticipants. 

0 

A notable exception is obtained at grade 1, where,the average score of the repeated participants 
exceeds that of the new ones. This reversal in the direction of differences may be explained by the 
fact that repeated participants must have some previdus school experiences (they recaived CE in 
f kindergarten, participated in some early-childhood CE programs such as Headstart, or flunked the 
first grade). Earlier Headstart evaluation revealed that children having prior experiences with 
Headstart or other preschools tended to achfeve better at the pretest than those who did not have 
such experiences (Coulson, 1972). Similarly, the higher pretest scores of theCE-repeaters at grade 1 
could be largely a reflection of the benefits of their earlier school experiences. 

The data in Table E-5 also show a clear trend that students with lower-achieving status (as indicated 
by lower pretest scores) receive more services (more hours and/or greater intensity), suggesting a 
p/acticeof allocating services in accordance with educational need even among CE students. 

To examine further how receipt of services may be related to the history of CE participation, we pre'- 
sent in Table 5-3 the distributions of services within each group of CE students. The data in this table 
reveal that a substantially smaller percentage of the misidentified participants receives services at 
the high cost level,, in comparison with either the repeated or the new participants. However, 
receipt of services in a given year seems to have little relation to history of participation. The 
misidentified participants receive less services probably because they are less needy, although we 
may also suspect that they miss some services because of their ambiguous status. 

Math Achievement and Services. The results of the analysis for math pretest scores are presented in 
Appendix E (Table E-6 for the 'participation history by, type of services' design and Table E-7 for the 
'participation history by level of services' design). 

Figure 54 highlights the principal finding from these tables. As in reading, the misidentified par- 
ticipants are clearly higher-achieving than the other participants. Except at grade 1, the new par- 
ticipants tend to achieve better at the pretest than the repeated participants. Again, an opposite 
direction of the differences between the repeated and new participants is evident at the first grade; 
and it may be explained similarly by the extra school experiences of the repeaters. 
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Figure 5-3 



Average Reading Scores at Pretest fir Reading CE Students by Participation pattern 
During the 1975-76 and 1976-77 School Years ' - 
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Table 5-3 

Percentage of Reading C\ Students Receiving Services at Four 
Levels of Effort, by Participation History 



Grade 



CE-Par t i cipa t ion 
in 1975-77 



Levels of Cost for Reading Services* 
! Low 



Total 





School Years 


High 


Average 


i 

\ Average 


Low 






In both years 


l a n 

JLO • u 


JX .0 


i 


11 Q 


100.0 




In 1976-77 only 


21.7 


28.3 


43.0 


7.0 


100.0 


X 


Uncertain* 


9.4 


23.5 


49.1 


18.1 


100.0 


1 


Total ; ' 


14.9 


27.0 


45.0 


13.1 


100.0 




. ) 

In both years \ 


* JLD • H 


77 Q 

JJ.3 


HX • V 


ft R 


100.0 


o 


In 1976-77 onl^ 


19.5 


32.4 


41.3 


6.8 , 


100.0 


£. 


Uncertain* v.j 


8.3 


22.4 


49.2 


20.0 


100.0 




Tot a 1 


13.6 


29.2 


44.6 


12.7 


100.0 




•in Dotn years 


X 7 . O 


7? 1 


7Q 7 


8.6 


100.0 


•3 


In 1976-77 only 


19.7 


35.2 


38.1 


7.0 


100.0 


J 


Uncertain 


7.4 


16.1 


53.5 


23.1 


100.0 




Total 


15.4 


27.0 


44.2 


13.3 


100.0 




In both years 


19.6. 


32.7 


38.8 


8.9 


100.0 




In 1976-77 only 


22.2 


30.8 


38.0 


9.0 


100.0' 


4 


.Uncertain 


7.0 


21.9 


40.9 


30.1 


100.0 




Total 


16.0 


29.1 


39.3 


15.6 


100.0 




In both years 


18.3 


33.2 


40.4 


8.2 


100.0 




In 1976-77 only 


18.5 


33.0 


40.3 


8.2 


100.0 


5 


Uncertain* 


7.0 


19.6 


49.5 


23.9 


100.0 




Total 


15.0 


29.2 


43l0 


12.7 


100.0 




In both years 


20.5 


32.4 


41.3 


5.8 


100.0 




In 1976-77 only 


14.9 


37.4 


36.6 


11.1 


100.0 


6 


Uncertain* 


5.5 


; 17.4 


49.5 


27.6 


100.0 




Total 


i4.9 


28.0 . 


43.5 


13.6 


100.0 



*This group of students received reading CE in 1976-77 according to their' 
school coordinators* reports in the Compensatory Education Roster; but in 
the Student Background Checklist, their teachers of record indicated that 
they did* not receive CE in that year. Because of the discrepancy between 
the two sources of data, we were uncertain about their CE-participation 
history. 

**The four levels of cost are defined in terms of the mean and standard 
deviation (s.d.) of the total standard-resource-dollar costs for reading 
services received, for all CE studerits within each grade, as fallows: 
High = one or more s.d. above the mean; High Average = zero to one s.d. 
above the mean; Low Average = zero tp one s.d. below the mean; and Low = 
one or more s.d. below the mean. 
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Note* — Students who received CE in 1976-77 according to records in the Compensatory 
Education Roster, but whose teachers did not identify them as participants 
in that year were classified into the group having 'uncertain' CE-participa- 
tion pattern. 



Figure 5-4 

Average Math Scores at Pretest for Math CE Students by Participation 
Pattern During the 1975-76 and 1976-77 School Year? 
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Table 

* \ 
Percentage of Math CE Students Receiving -Services at Four 
Levels of Effort, by Participation History 



Levels of Cost for Math Services* 
CE-Participation 



Grade 1 in 1975-77 High Low Total 

School Years High Average Average Low 





In both years 


13 


2 


38.4 


43.1 


5.3 


100.0 


• 1 


In 1976-77 only 


18 


3 


34.1 


41.5 


6.1 


100.0 




Uncertain'* 


, 7 


8 


23.2 


52.2 


16.8 


100.0 




Total 


11 


3 


29.8 


. 47.5 


11.4 


100.0 




In both years 


17 


9 


35.0 


39.1 


7.9 


- 100.0 


2 


In 1976-77 only 


27 


0 


28.8 


42.9 


1.3 


100.0 




* 

Uncertain 


8 


2 


22.1 


56.9 


12.7 


100.0 




Total 


13 


9 


27. 0o 


49.5 


9.6 


100 .-0 




In both years 


19 


3 


31.2 


43.2 


6.3 


100.0 




In 1976-77 only 


30 


5 


30.9 


34.4 


4.2 


100. Cft 


3 


Uncertain* 


4 


6 


20.6 


57.9 


16,9 


100 . 0 s 




Total 


14 


6 


26.4 


48.3 


10.7 


100.0 



In both years 21.3 32.0 43.8 2.9 100.0 

In 1976-77 only .14.9 28.2 53.0 4.0 100.0 

Uncertain* ■ 5.5 18.5 ' 61.8 14.2 100.0 

Total 13.3 25.4 S3.1 8.1 100.0 





c 

In both years 


20 


0 


27 1 


47.3 


5 


7 


-100.0 




In 1976-77 only 


17 


.0 


34,8 


43.3 


4 


.9 


100.0 


5 


Uncertain* 


5 


2 


24.4 


55.5 


14 


.9 


100.0 




Total - 


13 


3 


27.3 


50.0 


9 


4 


100.0 




In both years 


22 


2 


24.6 


49.7 


3 


.4 


100. 0 




In 1976-77 only 


21 


.4 


33.8 


41.6 


3 


.2 


100 ;0 


6 V 


Uncertain* 


6 


.0 


17.0 


63.6 


13 


.3 ' 


100:0 




Total 


14 


3 


21.9 


55.6 


8 


2 


1 100.0 



*This group of students received math CE in 1976-77 according to their school 
coordinators 1 reports in the Compensatory Education Roste'r; but in the Student 
Background Checklist, their teachers of record indicated that they did not 
receive CE in that year. Because of the discrepancy between the two sources 
of data, we were uncertain about their CE-participation history. 

**The four levels of cost are defined in terms of the mean and standard 
deviation (s,d.) of the total standard-resource«-dollar costs for math 
services received, for all CE students within each grade, as follows: 
High = one or more s t d f above the mean; High Average = zero to one s.d. 
above the mean; Low Average = zero to one s.d. below the mean; and Low = 
one or more s f d t below the mean, 
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Regarding the relationship between receipt of services and achievement status, we find from Table 
E-7 evidence that show^ a practice of increasing services for the lowf r-achieving students. This find- 
ing is parallel to that in reading. 

The distributions of services over each group of math CE students are described in Table,5-4. The 
data show that few of the misidentified participants (about 5 to 8 percent) receive services at the 
high cost level, while more than 70 percent of them receive services at levels below the average 
cost for all CE students. In comparison with the misidentifed participants, the repeated and new 
participants generally receive more services; but. the two groups do not di/fer substantially with 
respect to the distribution of services, and their differences are inconsistent across grades. 

Conclusion. In both reading and math, the misidentified participants tend to achieve better at the 
pretest and receive less services than the participants who are* unambiguously identified. The 
repeated participants on the average have slightly lower pretest scores than the new participants; 
and the two groups also differ insubstantially with respect to receipt of services. Disregarding their 
histories of participation, CE students who receive more services during the year are typically lower- 
achieving at the beginning of that year. 

Taking these findings together, we believe that there is a tendency to allocate services according to 
need. History of participation, however, does not seem to make a large difference in service 
allocation. In general, CE students who achieve better relative to their CE peers are likely to be 
misidentified as non-participant3 by their teachers; and, in addition to receiving less services, it is 
possible that they could also miss other special treatments. This last comment could have relevant 
implications for CE policy (e.g., should the teachers be informed of their students' CE status), 
although it is not of primary interest here. 

*• * •> 

Achievement Growth in Relation to History of CE Participation 

In this section, achievement gains are compared among the groups of CE students having different 
participation patterns in order to examine how repetition of CE participation in a successive year 
can affect achievement. Our aim is to assess the relative validities of three hypotheses concerning 
the effects of continued CE services: the incremental' effects, the' diminishing effects, and the 
Independent effects. The detailed results of the analyses are given in Appendix E. Here, we will 
discuss the findings for reading and math separately. 

The Effects of Repeated Participation in Reading CE. The results of the ANOVA with type of services 
as the cofactor and those of the ANCOVA with three service composites as covariates (the first and 
the second methods of adjustment Ifor instructional differences, see the section on Evaluation 
Design) are presented in Table E-8, while the results of the ANOVA with level of efforts as the co- 
factor (the third method of adjustment) are presented in Table E-9. In each table, data are summariz- 
ed- with respect to three indexes of achievement growth. 

Before we examine the 'main effects of the CE-participation factor, it is necessary to determine 
whether these effects vary with the characteristics of the instructional services received. This ques- 
tion can be answered by the tests of the interaction between the CE participation and the service 
factors in the ANOVAs, and by the tests of parallel regression surfaces in the ANCOVA. With rare 
exceptions, these statistical tests are generally insignificant (at the .01 level) regardless of the indexes 
of growth used and the methods of analysis employed. We conclude that the effects of CE- 
participation history do not differ as the type, intensity, and/or amount of services vary. 

<. 

Hence, the issue of the effects of participation history can oe addressed primarily by studying the 
adjusted main effects of the CE-participation factor (that is, adjusted for instructional differences) in 
the ANOVAS, and by comparing the adjusted group means in the ANCOVA. The results based on 
each of these methods are similar. Furthermore, the adjusted and the observed group means 
generally exhibit the same patterns of the differences between the repeated and the new par- 
ticipants. However, the results appear to differ occasionally when different indexes of growth are 
analyzed.^ 



Table 5-5 presems the observed mean gains for CE students who participated in both 1975-76 and 
K 1976-77 school years (repeated participants), who participated only in 1976-77 (new participants), 
and whose partici >atior> in 1 976-77 are not certain (misidentified participants). Examining the mean 
.differences, we fi.id that typically the misidentified participants have the smallest means among the 
groups, &s this group always achieves higher pretest scores than the other groups, their smaller 
gams may be partially attributed to regression artifacts, however, the differences are frequently too 
substantial to be ignored completely. We suspect that the misidentified participants do not gain as 
much because their teachers, being unaware of their CE status, may inadvertently fail to provide all 
the additional help intended for them. ^ 

i 

The statistical tests in Tables E-8 and E-9 consistently reveal significant differences among the groups 
• at grades 1 and 3. Aggrade 3, the difference lies primarily between the misidentified participants and 
the other participants, the differences between the repeated and new participants are compara- 
tively small, though the Repeated participants appear to do slightly better. Because the repeated par- 
t.-.ipants at this grade have slightly lower pretest means, this small difference could be spurious, a 
case of the regression-toward-the-mean phenomenon. We.are therefore cautious about considering 
this finding as evidence for incremental effects. 

On the other hand, at grade 1 , the repeated participants gain substantially more than the new ones, 
when residual gains are analyzed. This result suggests that repetition of CE at this grade may 
enhance the immediate effects, and gives support to the hypothesis of incremental effects. 

Turning to grade 2, we observe an opposite direction of the differences, new participants appear to 
gam slightly more than the repeaters, but these differences are statistically insignificant at the .01 
level. Considering the large sample sizes, this result gives little support to the hypothesis of 
diminishing effects. Nevertheless, it is interesting to note that the Compensatory Reading Study 
(Tnsmen et al., 1 975) also found that at grade 2, CE students who had received serviced before might 
benefit less from the immediate services than those who had no such prior exposure. We are not 
certain how this coincidence can be explained, particularly because it happens to be differeht from 
the findings at other grades. 

At grades 4, 5, and 6, differences among the groups are either insignificant or inconsistent across 
indexes of growth/The results for grades 4 and 6 in the Compensatory Reading Study were also not 
clear-cut. We think that the situation is undoubtedly more complicated at later grades because 
more school years have elapsed and there are many more ways in which the pattern of participation 
over the years can vary among students. For this reason, it would be difficult to sort out the effects of 
continued participation unless the >tudents' school experiences are followed for a long period. 

On the whole, we are disturbed that the findings vary with grades, an^ sometimes differ for different 
gam scores. The inconsistent results among indexes of gro>vth pose another problem concerning 
the appropriate measure for assessing the effects. We consider the present analysis inconclusive 
with regard to the nature of the effects of repeated participation in reading CE. 

The Effects of Repeated Participation in Math CE Parallel to Tables E-8 and E-9, we present the 
results of the math analyses in Tables E-10 and E- 1 1 . The statisticaltests on interactions and parallel 
regressions are consistently significant (at the .01 'evel) at grades 2 and 4 when instructional services 
are measured by numbers of hours (see Table E-10). in addition, there are also occasional 
significances at grades 1 and 3 in these respect', The significant test results suggest that the effects of 
the CE-participation factor may vary with tvyes or amounts of services. On the other hand, when 
instructional services are represented by levels of effort (see Table E-1 1), there are no significant 
interactions between the CE-participation and service factors except a. grade 1 . As the F-ratios in all 
of the significant cases are small relative to the large samples in the analyses, we regard these find- 
ings as weak evidence for differential effects of repeated CE participation according to instiuctional 
services. Therefore, we will focus our discussion on the overall effects of ttte'CE-participation factor. 
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Table 5-5 / - 

m i 

Average Achievement Gains in Reading for CE Students by Participation 
Patterns During the 1975-76 and 1976-77 School Years* 



CE Participation in 1975-77 School Years 
Grade Index of - . - 





Gain** 




In Both Years 


In 1976-77 Only 


Uncertain 




Z-Score 'Gain 




0 


02 


0.06 


-0 


.10 


1 - 


Residual Gain 


A 


ii 




7.S9 


-4 


.77 ' 




Residiial Gain 


B 


14 


88 . 


2.76 • 


-7 


.90 




Z-Score Gain 




0 


05 


0.09 


0.01 


2 


Residual Gain 


A 


— 1 




1.90 


0 


.18 




Residual Gain 


B 


-3 


13 


4.97 


-1 


.60 




Z-Score Gain 




0 


08 


0.06 


-0 


.01 


3 


Residual Gain 


A 


0 


37 


c -0.53 


-6 


.82 




Residual Gain 


B 


2 




2.19 


-6 


.14 




Z-Score Gain 




0 


02 


0.03 


-0 


.00 


4 


Residual Gain 


A 


-0 


43 


0.15 


-3 


.52 


c 


Residual Gain 


B 


4 


49 


-2.66 


-3 


.77 




Z-Score Gain 






02 


0.05 


' -0 


.03 


5 


Residual Gain 


A 


A 20 


43 


2.51 


-3 


.19 




Residual Gain 


B 


-0 


46 . 


4.56 


-2 


.53 




Z-Score Gain ' 




0 


04 


0.06 


-0 


.02 


6 


Residual Gain 


A 


-4 


99 


-2.96 ' 


-4 


.26 




Residual Gain 


B 


7 


68 


3.96 


-2 


.25 



*Sample sizes can be found in Table E-4 of Appendix E. Students who received 
reading CE in 1976-77 according to our records in the Compensatory Education 
Roster, but their teachers did not identify them as participants . in that 
year were classified into the gorup having 'uncertain 1 CE-participation pattern 

*Z-score gain is obtained by transforming the percentile scores into standard- 
normal -deviate scores. Residual gain A is obtained as pbserved posttest 
vertical-scale score minus that predicted by the regression model developed 
based on data for non-CE students attending non-CE schools. Residual 'Gain B 
is obtained similarly, but the regression model is based on data for non-CE 
students attending CE schools. In both models, posttest scores are predicted 
from pretest scores and selected student-background characteristics. (See 
Appendix B5 for more explanation.) x 

Note. — The sample includes only CE students for whom there are data for all 
the variables required in the analysis (test scores, background 
characteristics, and CE-participation records for the two years), 
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Again, the results With the three methods of analysis are mostly in agreement. We first note that 
when the Z-score'gains are analyzed, the statistical tests on the effects of participation histcy are 
insignificant at all grades. This result suggests that with respect to improvement of percentile ranks, 
the hypothesis of independent effects is correct. However, this hypothesis is not supported univer- 
sally when other indexes of the effects are examined.* 

The analyses of residual gain scores show that after adjusting for instructional effects, the main 
effects of the CE-participation factor are significant (at the .01 level) at grades 1, 3, 5, and 6. These 
significances are consistent among the methods of analysis and between the two kinds of residual 
gains. Note also that at these grades, there are few interactions between the service and participa- 
tion factors. 

Because the adjusted and the observed group means reveal the same patterns of differences among 
the groups, we present only the observed means in Tablet 5-6. In terms of residual gains, we again 
find from Table 5-6 that at grades 1, 3, 5, and 6, the misidentified participants generally have the 
lowest mean gains, raising the same concern that they may have been overlooked in the provision 
of CE services. 

Concerning the effects of repeated participation, the data for grades 1, 3, and 6 indicate that the 
repeated participants usually attain substantially larger gains than the new participants. These results 
support the hypothesis !of incremental effects when CE participation continues in a successive year. 
By contrast, the means at grade 5 reveal an opposite result: the mean gain of the new participants is 
considerably higher than that of the repeaters, a finding that supports the hypothesis of diminishing 
.effects. v ' 

Finally, the general results at grades 2 and 4 indicate thaf history of participation does not noticeably 
affect the immediate achievement growth of CE students. Thus, the hypothesis ofjndependent 
effects is supported at these two grades, incidentally, we ren^jrk that, although insignificant, the 
new participants show a larger average gain than the repeate^at grade 2, a result reminiscent of 
that in reading. 

In summary, we find three different possibilities when math CE services are continued in a subse- 
quent year: the effects are' incremental at grades 1, 3, and, 6, diminishing at grade 5, and not 
influenced by previous experience at grades 2 and 4. 

The different results at different grades prevent us from making a uniformjecommendation on the 
policy of continuing CE services for low-achieving students. We suspect that the different findings 
among grades may be artifactual, reflecting mostly the curricular differences and the different 
characteristics of the achievement tests at different grades. Specifically, we think that introduction of 
new concepts and skills, such as set theory and fractions, into the curriculum and the achievement 
tests at grade 5 may explain the unique finding there. It is possible that the instructional contents for 
the repeated and the new participants are different at this grade because of their differences with 
respect to readiness for the new skills. 

For instance, the new participants may only need help in the new skills and therefore the teachers 
concentrate on assisting them to master those skills which are measured in the tests. On the other 
hand, the repeaters may still be behind in the basic skills taught at earlier grades. Because the 
mastery of these basic skills is required in order to learn the new ones effectively, tns supplementary 
services for the repeaters are toncentrated on instruction of the old skills rather than on direct 
instruction of the new skills. As a result, the accelerated achievement of the new pa ticipants can be 
demonstrated with a test that emphasizes the new skills, whereas such a test wcu!d be insensitive to 
the improvement made by the repeaters during that year. This phenomenon may explain the lower 
mean gams of the repeaters at grade 5. However, we do not have pertinent data (such as the dif- 
ferential contents of instruction for the two groups of students) to verify this conjecture. 
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Table 5-6 



Average Achievement Gains in Math for CE Students by Participation 
Patterns During the 1975-76 and 1976-77 School Years* 



Grade 



CE Participation in 1975-77 School Years 



Index, of 





_ . ** 
Gain 


In Both Years 


In 1976-77,, Only 


Uncertain* 




Z-Score Gain 


0.15 


0.05 1 


-0.05 


1 


Residual Gain A 


18.41 


6.85 ■ 


1.31 




• - Residual Gain B 


11.47 


1 . 35 


-4 . 1C 




Z-Score Gain 


-0.01 


0.00 


-0.01 


2 


Residual Gain A 


1.48 


3.26 


0.43 ' 




Residual Gain B- 


-7 .82 


7 .33^ 


, -2.94 

r 




Z-Score Gain 


0.09 


0.13 


0.00 




Residual Gain ' A 


,23.64 


7.74 


-4.10 




Residual Gain B 


■ -3 . 18 


0.15 


-7.95 




Z-Score Gain 


0.02 


0.06 


-0.06 


4 


Residual Gain A 


-1.29 


2.40 


-4.89 




Residual Gain B 


-8.42 


7 6.61 


-5.98 




Z-Score Gain 


0.07 


0.16 


0.00 * • 


5 


Residjaal Gain A 


- 4.34 


13.86 


-0.12 




Residual Gain B 


2.32 


12.37 


-3.24 




Z-Score Gain 


0.10 


0.04 


-0.00 


6 


Residual Gain A 


11.71 


7.35. 


-1.89 




Residual Gain B 


16.02 . 


0.61 


-3.72 



0. 



*Sample sizes can be found in Table E-6 of Appendix E. Students who received 
math CE in 1976-77 according to our records in the Compensatory Education 
Roster, but their teachers did not identify them as participants in that year 
were classified into the group having 'uncertain' CE-participation pattern. 

**Z-score gain is obtained by transforming the percentile scores into standard- 
normal -deviate scores. Residual Gain A is obtained as observed posttest 
vertical-scale score minus that predicted by the regression model developed 
based on data for non-CE students attending non-CE schools. Residual Gain B 
is obtained similarly, but the regression model is bcsed on data for non-CE 
students attending CE schools. In both models, posttest scores are predicted 
from pretest scores and selected student -background characteristics. (See 
Appendix B5 for more explanation.) j 

Note. — The sample includes only CE students for whom there are data for all 
the variables required in the analysis (test scores, background 
characteristics*, and CE-participation records for the two years) . 
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Concluston. In general, the effects of repeated CE participation do notvary with the characteristics 
of instructional services. In both reading and math, our data for grades 1 and 3 tend to support the 
hypothesis of -incremental effects of continued CE services. At other grades, the findings differ 
* between reading and math. In math, the hypothesis of incremental effects is also supported by the 
data for grade 6^ while the data for grade 5 support the opposite hypothesis, the hypothesis of 
diminishing effects. In the remaining cases, there is little evidence that the immediate effects of CE 
vary with student- participation historv either in reading or math, that is, the hypothesis of indepen- 
dent effects is supported. We do not have sufficient data to explore further why the results are dif- 
ferent at different stages of schooling, but we raise a conjecture that the differences may be arti- 
factually related to the^aracteristics of achievement tests and curricula. 

Although the results are similar regardless of the analysis methods employed, they sometimes differ 
between indexes of growth. Thus, we are concerned about the appropriate measure of the effects 
under investigation. Certainly different indexes could have different meanings and therefore would 
give different results. But then which one is the most meaningful (or most important)? Due to the 
limitation of the single-year data, we leave further explorations to future analysis. We hope that 
when the educational experiences of the students are traced for more years, a clearer picture wil]_ 
emerge. 

SUMMARY AND CONCLUSIONS 1 

Two important issues on effective allocation of CE services are addressed with the first-year data 
from the Sustaining Effects Study. The first issue concerns the best time for providing CE services, 
that is, whether CE services are more beneficial at an earlier or later stage of schooling. Based on the 
cross-sectional data, this question is answered by examining the differential effects of CE at elemen- 
tary grades. The evaluation results in Chapter 2 are summarized in terms of four indexes: vertical- 
scale-score gam as a percentage of the gain associated with the 50th percenti'e rank of the national 
norm, observed posttest score as percentages of two kinds of expectations, and change of percen- 
tile score from pretest to posttest. These indexes of achievement for CE students are compared 
among grades with reference to their differences from the respective indexes for (he educationally 
needy non-CE students. The conclusions from these comparisons are recapitulated below. 

• For both reading and math, the effects of CE are relatively larger at the earlier grades. The 
relative effects at different grades, however, do not reflect their relative CE efforts. In light of 
these results, we think that CE can more efficiently improve the achievement of its par- 
ticipants at the earlier grades when learning problems are remedied in time. 

• The differential effects of CE by grades are more pronounced in reading than in math. The 
positive effects of reading CE are primarily noticeableat the first three grades; and not detec- 
table at grade* 4 and 5. For math, the positive effects are more or less detectable at all grades, 
but particularly substantial at grades 1 and 3. 

i • The positive effects of both reading and math are evident mostly for the programs that 

receive all or partial support from Title I funds. The programs that receive funds exclusively 
from non-Title I sources infrequently demonstrate beneficial effects on the achievement of 
their participants. 

The second issue deals with the effects of continued CE participation. Because student participation 
history is traced back only one year, the investigation is confined to testing three simple hypotheses 
on how participation in a preceding year may influence the effects of current CE services. The 
hypotheses are. (1) incremental effects (the immediate effects of current CE are enhanced by 
previous participation), (2) diminishing effects (the immediate effects are reduced when participa- 
tion is repeated),, (3) independent effects (the immediate effects are not influenced by history of par- 
ticipation). It must be emphasized that our interest is not in the accumulation of CE effects over 
years, but in the immediate effects of the services provided during the year. The cumulative effects 
cannot be properly determined with achievement data in a single year, and will be studied in subse- 
quent reports. 




The relative validities of the three alternative hypotheses are assessed by comparing the achieve- 
ment growth (during 1976-77) of two groups of CE students; those who participated in both 1976-77 
and 1975-76, and those who participated only in 1976*77. The conclusions -of our analyses are as 
follows: 

• Both in reading and in math, there is little evidence for interaction between instructional ser- 
vices and history of CE participation with regard to their effects on achievement growth. That 
is, the effects of repeated CE participation do not vary noticeably with the characterisfics of 
the instructional services provided. 

• The data appear to support different hypotheses depending on the grades and subject areas. 
At grades 1 and 3, the hypothesis of incremental effects is supported, for both reading and 
math CE. In addition, the incremental effect of math CE also receives support frpm the duta 
for grade 6. The math data for grade 5, however, support the opposite hypothesis of 
diminishing effects. In other ca^es, there is little evidence that the immediate effects ofCEare 
influenced by previous participation. Thus, the analysis is inconclusive regarding the nature 
of the effects of continued CE participation. Until there is further clarification of the issue by 
the longitudinal analysis, we would recommend, on the basis of the present findings, the 
policy of continuing CE services to the needy students. 

• As a byproduct of our analysis, we find that CE students who are not so identified by their 
teacher^ tend to receive less services; after adjusting for instructional differences, they still 
make smaller improvement in achievement than the CE students who are correctly iden- 
tified. This result raises a suspicion that the misidentified CE students (who tend to achieve 
higher pretest scores relative to their other CE peers) may benefit less from CE because they 
may have missed some of the special treatments. 

In conclusion, the cross-sectional analysis confirms the intuitive belief that earlier CE is likely to have 
greater impact. On the other hand, the analysis reveals some complicated relationships between 
participation history and the effects of CE. In order to use the limited CE resources effectively and to 
design programs that can efficiently serve the long-term CE participants, it is important that we 
understand the long-term effects of CE. In this respect, the nature of the effects of continued CE- 
service and their possible interactions with the kinds of services provided require ample attention in 
the future analysis. 
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' - INTRODUCTION TO PART II ' 

In* Part I o{ this report, interest is fdcused on the effects of compensatory services. In this second 
part, we shift the concern to the general relationships between academic development and 
education. . . . " 

" ' ** . I 

First, Jthe overall effects of instructional time and four operational dimensions of education 

(characteristics of instructional personnel, school environment, teacher's practices, and class 

organization) are considered in Chapter 6. Both the independent effects of each educational 

variable and thexombined effects of the variables are assessed in order to further our understanding 

of the mechanism tmderl; 7 .i.g the complex relations between the educational process and student 

development. The aim is.to increase our knowledge of what constitutes an effective program for 

improving achievenre.nt. Although a few useful findings are obtained, the results of the analysts 

generally>do net reveal strong evidence of the effects of variables that have lorigbeen <?on§jdered 

important (e.g., the individualization of instruction)/ ' * * 

4 Despite the discouraging results of Chapter 6, we continue the search for ways to improve the 
design of programs by a different but complementary approach. In Chapter 7, we employ the 
technique of discriminant analysis Jo determine^the educational factors that are useful in 
distinguishing between programs for students achieving high andjow growth. The idea is that the 
educational variables having substantial effects are expected to produce the differences between 
the achievemeftt of students. Therefore, thapesults of the discriminant analysis can be used to verify ' 
the findings in^he previous chapter. Furtflermore, the alternative way of analyzing the data may 
HfetpTdiscover other effective ed ucational methods that may have been overlooked by the regression 
analysis because it assumes a uniform, linear relationship between the variable and achievement for 
the entire range of the achievement scores. Although a clear picture still does not emerge from the 
discriminant, analysis, it provides additional information on what methods *may improve the 
effectiveness of education. 

Finally, as the effects of education may be dependent on student characteristics, the earlier analysis 
without consideration of the interaction effects between the educational process and student 
background may obscure the findings. To refine our analysis, such interaction effects are explored 
in Cnapter 8. However, the consideration of the interactions again does not make the results clearer 
than what has been learned in earlier chapters. . ■ , / 

The general conclusion from all these analyses is that there are few slable, consistent, and pro- 
njounced relationships between the various educational aspects and academic development. 
Where differences are revealed among grades with regard to these relationships, the differences 
mostly do not have systematic patterns and are not obviously interpretable. Nevertheless, combin- 
ing the evidence obtained with the different analyses, our results suggest that a general picture of 
relatively more effective programs may be as follows: 

• more time for regular instruction by classroom teachers; 

• instruction by more experienced teachers; 

• giving feedback to students concerning their progress more frequently; 

• Reducing physical fights, violence, and other disruptive behavior of students that cause dis- 
turbances of instruction. 
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In addition, among the school's existing conditions, it is found that high concentration of low- 
achieving siudents in the school is generally unfavorable to student progress. It might be that 
schools with larger proportion of low-achieving students usually have greater educational burdens. 
More assistance to these schools to upgrade their programs is therefore needed. In this regard, it is 
encouraging to see the recent recommendation in the legislation to consider school/s educational 
need (assessed in terms of number or proportion of educationally deprived children in the school) 
as an additional criterion for determining the eligibility of the sthool to receive Title I funds. 

The lack of important and meaningful findings in the second part of this report couH in part be, 
attributable to the sht>rt period of the schooling examined. We hope that subsequent analyses of the 
multi-year* data will reveal \ better picture regarding how to design effective programs. 
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CHAPTER 6. EDUCATIONAL DEVELOPMENT AND 
THE PROCESS OF EDUCATION 



The role of education in the academic development of students is examined in terms of 
five major dimensions. In addition to instructional time which has been investigated in 
previous chapters, four operational and contextual aspects of the educational process that 
are not related to time are also considered: qualifications and attitudes of teachers, school 
environment, teacher's practices in the classroom, and school's policy of organizing 
classes. Exploratory analyses are performed to determine the factors that have either direct 
or indirect effects on achievement The effects of each dimension are assessed first by its p 
marginal influence that is the resultant of the direct relation to achievement and the 
indirect relations because it covaries with other dimensions affecting achievement. Then, 
the partial effects attributable to the direct relation alone are estimated by statistically con- 
trolling for the other dimensions. The marginal and the partial effects of the five dimen- 
sions are considered together in order to understand the relationships between education 
and achievement. ' i 

The school-year analyses reveal few systematic relations between achievement growth and 
the educational process as described by the data for this study. Similar to the findings in 
previous chapters where the marginal effects of instructional time are assessed without 
controlling for other educational aspects, the negligible impacts of the amount of special 
instruction are reconfirmed. However, there is again evidence that amount of regular 
instruction has a positive but modest effect Among other dimensions, only instructional 
. personnel and school environment appear to have been measured by variables that are 
consistently related to student's progress. Experience of the teachers, as reflected in years 
of teaching, is the only characteristic of teachers to demonstrate substantial, positive 
effects on both reading and math achievement With regard to environment, high concen- 
tration of low-achieving students in the school, suggesting its likely disadvantages both in 
learning climate and in the burden of educating deprived children, can hamper the 
academic progress of its students; such negative effects are consistently evident in math. 

Unable to support the effects of various educational methods, teacher practices in par- 
ticular, the results of this chapter are not very helpful to the design of effective programs. 
The distal measures of the educational dimensions and the short period of schooling 
examined are probably the reasons for such discouraging results. 

In the preceding chapters, we have found some evidence that compensatory programs have helped 
Title I students in improving their achievement. However, there are generally no strong relation- 
ships between amount of instruction and achievement growth. In particular, there is little evidence 
that amount of special instruction, which distinguishes between the services received by CE and 
non-CE students, has positive impacts on achievement. Thus, we remain concerned about the 
aspects of educationa 1 process that effect improvement. In addition to instructional services, we 
now expand our attention to other dimensions of education that may be effective in promoting 
achievement. It is possible that teacher behaviors in the classroom (e.g., how they interact with the 
students and how they structure their instruction) have greater influence on learning than the 
amount of different kinds of instruction. 

The Sustaining Effects Study has obtained general information on the educational experiences of 
elementary students in a national sample of schools, by the methods of questionnaire survey. The 
data include characteristics of teachers, their practices in the classroom, and other school condi- 
tions and policies that may affect learning. In this chapter, we examine the data collected during the 
1976-77 school year to begin our inquiry into, the relations between the educational process and 
achievement. The purpose is to obtain from the first-year data useful information to guide later 
analyses of the multi-year data. The analyses in this chapter are intended to be exploratory. This 



choice is based on the consideration that this report covers only eight months of the development 
process, and the educational dimensions are measured only once during this period. Because of 
these constraints, the data do not afford the formulation of an adequate model to describe the 
causal relations among the educational and achievement factors. 

To achieve the ultimate objective of determining the important factors in the achievement process, 
the three-year data will be analyzed with structural-relation models in a later report (Report 15). In 
addition, the substudy of Successful Practices in High-Poverty Schools has gathered in-depth data 
on the educational process in a subsample of 55 schools by means of classroom observations and 
teacher interviews. These data have been collected for the 1978-79 school year and are analyzed in 
Report 16. The results of these analyses can complement those obtained in the longitudinal study 
that includes a larger sample but has less penetrating data. By coordinating the analyses from these 
interrelated reports, we hope to find an accurate picture of the effective programs that can be 
adopted by schools to better the achievement of their students. 

The results of the analysis in this chapter do not reveal much useful information regarding what pro- 
gram characteristics are particularly effective in promoting achievement. Specifically, the effec- 
tiveness of individualization and strong leadership of the principal, which are both believed to be 
important features of successful programs, receive little support from the analysis. These results may 
be discouraging but need not rule out the possibility of finding other effective practices. It is likely 
that the variables investigated fail to show substantial effects on achievement because the achieve- 
ment process being examined is too short or because they do not represent relevant information. 
Nevertheless, the general belief that experienced teachers are more effective than inexperienced 
ones does receive confirmation fr f om the data. 

Additionally, the relationships between the development of student attitudes and some of the 
educational dimensions (personnel, environment, and practices) are also examined. However, 
there are few noteworthy findings from such analyses, most likely a consequence of the ques- 
tionable validity and reliability of the student affect measure. u Q 

THE DATA AND ANALYSES STRATEGY 

For the present analysis, the educational-process variables are divided into two major sets. The first 
set of variables measures the amount of exposure to learning activities by time, and has been 
studied earlier. The second set describes the operational and contextual aspects of the educational 
process: the staff who deliver the instruction; the environment in which the program is 
implemented, teacher practices in the classrooms and methods of instruction, and school policy of 
organizing classes for instruction. Thus, five dimensions of the process are considered (time, person- 
nel, environment, practices, and organization); each is believed to have an effect on learning. We 
are interested not only in how each of these dimensions is related to achievement progress but also 
in the combined influence of the dimensions/ 

The Combination of Data for Students; Teachers, and Schools 

As explained in previous chapters, the time dimension is measured for each student on the basis of 
the student participation and attendance record (see Chapters 1 and 3). However, the educational 
environment and organization of classes are described for each school in general, while primary 
descriptions of instructional personnel and educational practices are obtained for each teacher. The 
school- and teacher-level measures are absorbed into-the data for individual students by means of 
student-teacher and student-school linkages. 

During the first year of this study, all students having usable achievement data remain in the same 
school so that the mapping of the school data to the student data is a very simple matter. On the 
other hand, because there are frequently multiple teachers who provide instruction to a student, 
the translation from teachers' data to their students' data requires some averaging. The teacher 
linkages provide up to three teachers' names for each student in each subject, but do not show the 
proportions of time each student is instructed by each teacher. Consequently, the simple average of 




the data from multiple teachers is taken as an approximate measure for the student. Since only a 
small percentage of students have three teachers on record (see Report 9), the student data are 
based on either one or two teachers. 

«» 

For an individual student, the data on teacher practices may not be accurate not only because of the 
aforementioned strategy of averaging over teachers but also because teachers' typical responses to 
the questionnafre*Hems need not apply to each of their students equally. We expect teachers to vary 
their practices among students, but such detailed responses for each student are deemed impos- 
sible to obtain in a study of this large scope. Of further concern is that many important educational 
variables such as the daily interactions between the student and the teacher and the actual content 
of instruction are necessarily left out in the analysis because classes are not actually observed. As a 
result, the analysis model could suffer substantial specification error. 

Sometimes to make up for the omissions of these variables, dummy-coded variables for teachers or 
classes are introduced into the model to account for the relations attributable to the unmeasured 
teacher or class-level variable*. This strategy, however, often results in findings that lack substantive 
interpretation. As an alternative, aggregates of student-level variables (such as pretest scores and 
background characteristics) may be incorporated into the model to allow examinations of both the 
betwten-teacher and within-teacher relations simultaneously. This is the strategy commonly recom- 
mended in multi-level analysis, and can be similarly applied to examine the between-school and 
within-school relations in the same model. The aggregate measures are interpreted as proxies of 
substantive aspects of the classes or the schools (e.g., peer characteristics reflecting interactions 
among students, economic background of the school suggesting possible level of resources, and 
racial composition in the school indicating school climate). \ 

ti 

Because school aggregates are easy to obtain and because class aggregates are frequently similar 
within a school, the second strategy is followed by adding several school aggregates to the model. 
These aggregates at the school level are summarily interpreted as components of the school- 
environment dimension in this chapter. Thus, the general model of the analysis contains not only 
student, teacher, and school-level measures by virtue of the levels of data collection, but also 
school-level variables that are compositional or contextual. In .um, the analysis centers on student- 
level outcomes but uses mixed-level independent variables. It allows descriptions of the relation- 
ships between individual achievement and educational dimensions which function through the 
instructional personnel as well as school context. 

Analytic Approaches 

Having explained how the different elements of the data are to be used in the analysis, we now turn 
to address the analysis procedures. Although it is desirable to study causal relations between the 
educational process and achievement by means of structural-relation modeling, such an approach 
would be fruitful only if both the development of students and the process of schooling are followed 
over an extended period of time. Particularly important, proper examination of the interrelation- 
ships amongthe educational factors and their effects on achievement requires measuringthese fac- 
tors af different times. 

Because the withm-school-year data provide only one measure for each educational variable during 
the period, it is difficult to determine whether the relationships between two variables are direc- 
tionally causal or are simply reflections of their sharing similar causal relations with other variables. 
However, as the measures of the educational process are obtained for the school period between 
pretest and posttest administrations, it is reasonable to assume that they are determinants of posttest 
achievement. With these considerations, we believe that as an initial inquiry, it is appropriate to 
adopt a multiple regression approach which does not impose explicit causal connections between 
independent variables. 

Despite the long history of educational research, it is generally acknowledged that simple, reliable, 
and valid measures of the educational dimensions are still difficult to devise. The common practice 
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under the circumstance is to employ multiple data items that are thought to manifest the concept of 
interest. This strategy, however, has a tendency of resulting in numerous variables for each concept; 
many of^hem are either superficial or redundant and do not contain useful information for the con t 
struct th£y purport to represent. As the educational process under investigation is complex and little 
known, we are inevitably trapped in this situation, especially when the data are collected via a ques- 
tionnaire survey. 

Although we have carefully selected the variables for this study based on conceptual clarity and 
knowledge gleaned from earlier studies, there remains a large number of variables to be con- 
sidered. If all of these variables are used indiscriminately, the analysis would require uneconomical 
computations. Furthermore, confusion would abound when we attempt to interpret the 
voluminous but possibly trivial results. For this reason, it is important to screen trivia! variables from 
those that can actually contribute to the understanding of the achievement process. To accomplish 
the screening, the analysis is conducted in two phases. In the first phase, an appropriate model with 
reduced number of variables is developed on the basis of a 15 percent random sample of the first- 
year data. The selected model is f hen employed in the second phase to analyze the data from the 
whole sample. 

Phase One Analyse. The analysis initially concentrates on the selection from among all the variables 
measuring the same dimension. The joint relationships of the within-dimension variables with 
achievement growth are examined while variables for other dimensions are ignored. Obviously 
such a separate analysis of each dimension introduces specification error whenever one or more of 
the variables from the dimension under consideration are related to some variables for the other 
dimensions. That is, the independent effect of each variable is confounded with the indirect effects 
that are results of its covariations with variables for other dimensions. Because the variables for dif- 
ferent dimensions are only moderately correlated, we do not anticipate the separate analysis of 
variables within each dimension to distort their relationships with achievement significantly. Unless 
the omitted dimensions in each analysis have substantial influences on achievement and are influ- 
enced substantially and differently by the variables under examination, these initial analyses should 
result in proper selections of within-dimension variable^ that have non-negligible effects on achieve- 
ment. 

In fact, when the different dimensions are appreciably interrelated, it would be helpful to consider 
both the separate analysis within a dimension and the joint analysis of all dimensions in determining 
the variables that are worth considering in the final analysis. In this way, the marginal effects of each 
variable resulting from its unique relationship with achievement and the additional relationships 
attributable to its interrelations with other independent variables affecting achievement can be 
taken into consideration when we assess its role in the achievement process. As an example, if a 
variable has little independent effect on achievement but it causes changes on other variables that 
have substantial effects on achievement, then it should also be regarded as having an appreciable 
role. The resultant of the direct and indirect (because of relations with other achievement-related 
dimensions) effects of a variable is estimated in the within-dimension analysis. 

Of course, our major interest is in the variables that play an important role directly. For this reason, 
the variables that are selected based on the within-dimension screening are combined to form a 
new model. The new model is used to make the final selection of variables for the four dimensions 
that are not time-related. The time dimension is not considered in this further step because, on 
a prion grounds, this dimension is treated differently (see later discussion in this section). 

This further screening of the variables is designed to select educational factors based on 
simultaneous considerations of the within- and between-dimension relations among them. For con- 
venience of reference, we differentiate between two models in the phase one analysis: The sub- 
model deals with the relationship between each dimension of education and achievement growth, 
whereas the full-model examines the relationships between the four 'time-independent' dimensions 
and achievement in terms of the variables retained in the submodel screening. If the marginal effect 
of a variable (as estimated from the submodel) reflects primarily its indirect effects as a result of its 




influences on variables measuring other dimensions, the partial effect of this variable (as estimated 
from the full-model) would be small. In this case, unless its marginal effect is strong, it could be 
eliminated from the final analyses without much loss of information. <j> 

As remarked earlier, the analysis of the time dimension in phase one does not follow completely the 
strategy taken for other dimensions. Because instructional time is an indispensable factor of the 
educational process, the preliminary analysis is not intended to delete any component of this 
f dimension. Rather, the analysis is aimed at determining the best way to form a small number of 
composites from the original ten items in the student participation and attendance record. The 
items that share similar relationships with achievement can be combined to reduce the number of 
variables and increase the efficiency in the estimation of the regression coefficients. 

As the time dimension is measured by differentiating ten instructional arrangements on the basis of 
type of instructor and size of instructional group, it is reasonable to consider forming the composites 
by the categories of these two major elements of instruction. Examination of the effects of the com- 
posites so defined also provides answers to the popular questions concerning what kind of instruc- 
tor or what group sizejs more effective than others. A third possibility of forming the composites is 
to combine the components that best distinguish between the instruction received by CE and non- 
CE students. This method has been used in earlier chapters and will be compared with the 
preceding two methods in order to choose one of the three sets of composites for use in the phase 
two analysis. 



In both the submodel and full-model anal^es, a step-wise procedure is employed to screen the 
variables on the basis of their contributions to the explanation of achievement variation. The pro- 
cedure sequentially selects variables into the regression model for predicting posttest achievement 
by considering their effects after adjusting for the effects of variables that have already been selected 
at preceding steps. Thus, the first variable selected has the largest total effect; the second variable 
selected has the largest effect after partialling out the effect of the first variable, etc. In this way, a 
variable is selected either because it has large marginal effect or because it has large partial effect 
after other variables have been selected. In order not to overlook any variables that have potential 
effects on achievement, a lenient criterion (F for the significance of the regression coefficient is 
greater than 2.C) is adopted for including the variables in the selected model. 

Phase Two Analysts. In the second phase, only the variables that are judged to have potential effects 
on achievement during the phase one screening are included in the analysis. These selected 
variables are analyzed with the multiple regression method using the whole sample of the first-year 
data. The interest now centers on the direct effect of each variable and how all the five dimensions 
of the educational process jointly affect achievement progress. 

Problems of the Multiple-Regression Approach. In the multiple-regression analysis, the interrelations 
between variables are assumed to be mutual and non-directional. The primary loss of this approach 
is that the exact path of how an educational factor exerts its influence on achievement cannot be 
revealed. However, as many of the interrelations between the educational variables in our data 
base are theoretically ambiguous, we doubt that their causal relations can be properly described 
with stringent models. 

For instance, although it is reasonable to think that the experience of a teacher can affect his/her 
practices but not vice versa, the reality could be that they do not have direct relations but they are 
correlated merely because of their common link to other variables. One possibility could be that 
teacher experience and practices are correlated only because schools that encourage certain prac- 
tices also tend to retain teachers of particular experiences. Unless we have detailed information 
from the schools concerning their policies and/or we follow the changes of teacher practices across 
years, we can not have a clear picture of this kind of relationship. Considering the complexity of the 
interrelations among educational variables and the absence of important and relevant information 
needed to resolve such relations, we suggest that the regression analysis is a useful step toward 
understanding the achievement process as it is related to education. 
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Another problem in the multiple-regression analysis is that if the independent variables are highly 
correlated, the estimation of the regression coefficients can be quite urstable (having large standard 
errors). For this reason, in the presentation of the detailed results of the analyses in phase one, the 
proportion of the variance of an independent variable that is unexplained by other variables that 
have already been in the model is indicated in the table for each educational variable. This propor- 
tion is commonly known as the tolerance of the variable (and is equal to one minus the multiple 
between that variable and the variables entered prior to it). With the exception of the aggregate 
variables, the educational variables have very high tolerances, suggesting that collmearity is not a 
serious problem. Indeed, the intercorrelations among these variables are generally low (of 
magnitude smaller than .20)., 

Adjusting for the Effects of Background Factors. Because initial achievement and student 
characteristics have substantial relationships with later achievement, these background factors are 
always controlled for when we examine the effects of education on achievement. Thus, in all of the 
phase one and phase two analyses described above, the model always includes the pretest score 
and certain student characteristics (e.g., race/ethnicity, economic status as indexed by participation 
iajneal-programs) that prove to have substantial influence on achievement. 

In phase one, a hierarchical regression strategy is employed to select first the student characteristics; 
and then in the presence of pretest score and these student characteristics, the effects of the educa- 
tional variables are assessed to determine whether to include them in the model. In technical terms, 
the step-wise procedure assigns highest priority of en^ry to pretest score,' second priority to student 
characteristics, and considers -fast the entry of the educational variables. In phase two, the model 
analyzes simultaneously the pretest score, student characteristics selected in phase one, and the 
educational variables determined to have meaningful effects on achievement. 

EXPLORATORY ANALYSIS OF THE EFFECTS OF EDUCATIONAL 
PROCESS ON ACHIEVEMENT 

The analyses in phase one (using a 15 percent random sample of the data) serve two purposes, to 
select nontnvial variables for further analysis in phase two and to study the marginal effect of each 
educational dimension separately. Asa reminder to the reader, the marginal effect of a dimension is 
the resultant of its direct influence (which the dimension exerts independently on the outcome) and 
its indirect influences (which it exerts via other achievement-related dimensions). For instructional 
services, the differential effects of amounts of instruction by type of instructor and by size of group 
are discussed. For the other four dimensions that are not time related, each dimension is considered 
alone first, and then the four are jointly examined in order to select a subset from their component 
variables to represent the characteristics of the educational process in the phase two analysis. 

The effects of education are assessed with a regression model that describes the posttest achieve- 
ment as a linear funct.on of the pretest achievement, student characteristics, and the educational 
variables. The posttest and pretest achievements are measured by the scores attained on the SDG 
recommended level of the Comprehensive Test of Basic Skills (CTBS, see Chapter 1). Four student 
characteristics that are shown to be predictive of achievement growth in Chapter 2 are employed as 
potential background variables, need for compensatory services as judged by teachers, educational 
attainment of the mother, participation in the free or reduced-price meal programs (an index for 
family economic status), and white/minority status. Some of these background variables may be 
omitted if they prove to have negligible contributions during the step wise selection process. The 
educational variables will be described in the following sections when their effects are discussed. 

The Marginal Effects of Learning Time by Kind of Instruction 

The amount of time each student spent in learning activities is estimated from the first-year data for 
each of the ten instructional arrangements listed in the Student Participation and Attendance 
Record his section, the ten components of the total instructional time are analyzed in three 
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parallel ways: by the type of instructor involved, by the size of group in which the instruction is 
received, and by the instructional setting as defined earlier (see Chapter 3) in terms of the compo- 
nent's ability to differentiate the receipts of services between CE and non-CE students. 

The "ways of combining the ten components into appropriate composites for the three sets of 
analyses ar^ illustrated in Figure 6-1. The results of these analyses are not independent of one 
another because the composites simply represent different groupings of the same data. The reason 
for these interdependent analyses is to address the questions regarding the effects of different types 
of instructor and different sizes of instructional group. At the same time, the results provide some 
empirical bases for choosing a particular set of composites to be used in subsequent analyses. The 
set of composites that is most meaningful and can jointly explain most of the achievement variations 
will be selected to represent the time dimension of the educational process in the analysis of phase 
two. 

In terms of the type of instructor involved, four composites of learning time are formed- time spent 
with classroom teachers, special teachers, other personnel (aides, assistants, or tutors), and in 
independent seat work (without instructor). If type of instructor is a more critical element of instruc- 
tion, with respect to its effects on achievement, then these four service composites would be more 
likely to have differential effects than other sets of composites. In this case, the analysis using this set * 
of composites would also be expected to result in a larger multiple correlation than when other sets 
are used. 

The second way of examining the effects of learning time is focused on the size of instructional 
group. Three different sizes are considered: large group (consisting of 14 or more students), medium 
group (approximately 7 to 13 students in the group), and small group (approximately 1 to 6 
students). Ag^in, if group size is the more important element of instruction, th*n the analysis based 
on this set of composites would be more productive (revealing greater differential effects and a 
larger multiple correlation). 

The last method of categorizing the data for instructional time is by instructional setting. Three set- 
tings are identified on the basis of the different emphases on instruction between compensatory and 
regular programs: regular instruction (by classroom teachers and in medium or large groups), 
special instruction (by special teachers, aides or in small groups), and tutor/independent work (work 
with tutors or with study materials independently). This set of composites has been used in Part I of 
this report because of the special interest in the effects of compensatory education there. 

The detailed results of the three parallel analyses for reading and math are presented in Appendix F 
(Tables F-1 to F-6, one table for each grade). Of particular interest in these tables are the partial cor- 
relations between each service composite and posttest achievement. The partial correlations are 
traced throughout the analysis steps as each background factor is addeel to adjust for its con- . 
founding effect on achievement. These data can help us understand the role of student 
backgrounds in the relationships between achievement and instruction, particularly with regard to 
the difficulty in showing a positive effect of the amount of special instruction. 

By studying the pattern of these partial correlations, we can obtain a clear picture of how the pretest 
achievement and background variables affect the receipt of services and the posttest achievement 
concurrently. Specifically, amounts of instruction by special teachers, in small groups, or in a special 
setting all have negligible effects on achievement. However, because more of these kinds of instruc- 
tion is given to low-achieving students who are likely to come from disadvantaged families (poor, 
minority, or having less educated mothers), they can appear to have negative impacts on achieve- 
ment if the background factors are not adequately controlled. Frequently, adjusting for the pretest 
differences alone is not sufficient to explain away the negative correlation between posttest achieve- 
ment and amount of special instruction. Although further adjustment for the background dif- 
ferences typically reduces the negative correlation to trivial, none of the adjustments has been able 
to produce a positive partial correlation. Thus, it is reasonable to conclude that amount of special 
instruction has little impact on achievement. 



177 



ERIC 




Hours of Instructional Services Received in the 1976-77 School Year 



BY TYPE OF INSTRUCTORS 
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In a group of 21 or more students 
In a group of 14-20 students 
In a group of 7-13 students 
In a group of 1-6 students 

> \ 

Special Teachers 

In a grou£ of 7 or more students 
In a group of 1-6 students 



Other Instructional Personnel 
(Aides/Assist ants/Tutors) 

Paid aides or assistants in a 
group of 1-10 students 

Tutors (student or adult volunteer) 



Independent Work 

Using programmed materials 
Using non-programmed materials 
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Figure 6-1 

Descriptions of the Three Sets of Composite Variables for Reading/Math Services, 
Obtained on the Basis jof Hours of Instruction Received in Ten Different 
Instructor/Grouping Combinations 
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For easy reference in our discussion, the results presented in Appendix F are summarized in 
Table 6-1. In what follows, we will examine the differential effects of instructional time by type of 
instructor, by size of instructional group, and by instructional setting. The results of these three ways 
of examining the effects of instructional time will be compared to decide which set of composites to 
use in phase two of our analysis. 

The Effects of Time by Type of Instructor. On the whole, the effects of learning time are smalt, 
regardless of the type of instructor used. Only in math does the analysis consistently indicate a 
small, positive relationship between the amount of instruction by classroom teachers and achieve- 
ment progress at four of the six grades (grades 2 through 5). Evidence of positive effects of instruc- 
tional tjme is sparse for the four types cf instructors in reading. In reading, amount of time spent 
.with special teachers shows negative effects at grades 3 and 6., Because reading instruction by 
special teachers is mostly provided to low-achieving students as compensatory services, especially 
at grade 3 and above (see Report 5 and Chapter 3), such negative effects are likely mere reflections 
of the inadequately controlled differences between the students who receive different amounts of 
this kind of instruction. 

The Effects of Time by Size of Instructional Croup. There are few appreciable effects of learning time 
on reading achievement. In reading, differentiation of time by group size in which instruction is 
delivered does not increase the chance of detecting the effects of time. However, amount of time in 
large-group and small-group instruction has some modest fcut positive effects on math achievement. 
This result in math is related to the finding obtained in terms of type of instructor, as large-group 
instruction is always provided by classroom teachers (a constraint of the data collection in this 
study) while small-group instruction mostly represents either independent work or instruction by 
classroom teachers. 

The Effects of Time by Instructional Setting. When instructional time is categorized in terms of set-, 
tings that distinguish between the services received by CE and non-CE students, amounts of special 
instruction and tutor/independent work generally have negligible effects on achievement. On the 
other hand, more time in regular instruction improves achievement growth, especially in math. This 
result suggests that increase of time in regular instruction is more likely to help raise the achieve- 
ment of students than use of special teachers or reduction of group size. 

As the length of a school day is limited, increasing the intensity of instruction may be a preferred 
form of compensatory services because it avoids keeping the students in school for extra hours or 
missing other activities. However, neither use of special teachers nor reduction of group size 
guarantees an improvement of the intensity or quality of services unless it is accompanied by 
changes in instructional style and method (such as increased attention to individual students). By 
comparison, increase of instructional time expands the opportunity for the students to learn, which 
can be particularly important for the educationally deprived children who often lack such oppor- 
tunity outside the school. In line with this argument, additional time of instruction for low-achieving 
students is to be encouraged. Nevertheless, the reader should pot be misled into thinking that 
instructional time alone will foster achieveme. owth. Although there is evidence of the positive 
effect of time, in math particularly, the effect is .tall. 

Selection of the Time Composites for Later Analyses. Considering the results of the analyses for both 
reading and math, we find that the three sets of composites for instructional time do not differ 
greatly with respect to their contributions to the explanation of achievement differences among 
students. The squared multiple correlations resulting from the regression analyses are practically the 
same regardless of which set o* the composites is used. The findings concerning the relationships 
between instructional time and achievement growth are similar among the analyses and show no 
obvious conflicting implications. 

In terms of the ejects of each composite, 14 of the 48 regression coefficients (29 percent) in the 
analyses by type of instructor meet the criterion of having an F-ratio greater than 2.0. (The 48 



ERIC 



179 




Table hA 



Summary Results From Prelimir^ry Fxtuiiination of the Effects of Amounts 
of Instruction on Achievement by Type of instructor, .By. Size of 
instructional Group, and b> taitaictional Setting 



Variables Describing 
Amount and Kind 
of Instruction 



Relation to Achievement 
Growth in Grade* 



By Type of Instructor 
Classroom Teachers 

Special Teachers 

Aides/Assistants/Tutors 

Independent Seat Work 



By Size of Instructional Group 

Large Group ! R: 

(14 or more students) M: 



Medium Group R: 

(Appr6ximately 7-13) M: 

Small Group R: 

(Approximately 1-6) M: 



By Instructional Setting 
Regular Instruction 



Special Instruction 



Tutor/Independent Work 



R: 


+ 


+ 










M: 


+ 


+ 


+ 


+ 


■ + 




R: 














M: 








+ 






R: 










+ 


+ 


M: 






+ 









The effects of amount of instruction on Reading (R) and Math (M) achievement 
are examined separately, after controlling for background differences among 
students. Type of instructor, size of instructional group, and instruc- 
tional setting represent three different ways to distinguish the kinds of 
instruction. The relation of amount of instruction to achievement growth is 
assessed in terms of the partial regression coefficient presented in Tables 
F-l to F-6 of Appendix F: 

indicates that amount of the particular kinQ of instruction has an 
effect on achievement growth that is positive and meets the criterion of F 
greater than 2.0 for inclusion in the prediction equation for posttest 
achievement. 

*-• indicates that the effect is negative and meets the inclusion criterion. 
• • 1 indicates that the effect is negligible in that it does not meet the in- 
clusion criterion. 
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coefficients are obtained from 12 analyses — six grades in readingand math, each having four coef- 
ficients representing the four types of instructors.) By size of instructional group, 11 of the 36 
coefficients (31%) meet the criterion, while 13 of the 36 coefficients (36%) in the analyses by instruc- 
tional setting do so. 

On the basis of its relatively greater chances to yield noticeable contributions to the prediction of 
achievement growth, the set of composites by instructional setting is selected to represent the time 
dimension in later analyses that examine the effects of instructional time jointly with other dimen- 
sions of the educational process. This set of composites also has greater capability to differentiate 
between CE and non-CE students in terms of their receipts of services (see Report 5). 

Conc/uiions of the Marginal f fleets of Time. Judging from the results of preliminary examination, the 
amounts of time in different kinds of instruction are not likely to be very critical in explaining 
achievement growth. Increasing the time of regular instruction by classroom teachers will slightly 
better the achievement. But in order to overcome the academic deficit of compensatory-education 
students in, this way, more additional instruction would be requFred than is practical or affordable. 

In general, amount of instruction has greater effects on achievement in math than in reading. This 
result is congruent with the previous finding of greater effects of compensatory services in math. In 
reading, time is positively related to achievement progress only at the first two grades. A similar find- 
ing was also obtained in studies by Guthrie and his colleagues (Guthrie, Samuels, Martuza, Seifert, 
Tyler, and Edwall, 1976), and by Coles et al. (1976). The lack of evidence for positive time-effects in 
the upper grades is probably attributable to th;. greater emphjasis on provicl ; ng more instruction to 
lower-achieving students in these grades (see discussion in Chapter 3). This phenomenon also helps 
explain why the effects of compensatory reading services are negligible or relatively smaller at the 
higher grades. It can be argued that if amounts of time for different kinds of instruction do not affect 
achievement appreciably* then providing more instruction to compensatory-education students 
could not be expected to raise their achievement status. 

Although Wiley and Harnischfeger (1974) have made a strong case for the importance of instruc- 
tional time in improving achievement, their opinion receives only weak support from the school- 
year analysis. Most recently, Cooley and Leinhardt (1978) also found that amount of time had little 
relationship with either achievement gain or achievement level. It is likely that the immediate effects 
of learning time are small, but the long-term effects jean be substantial. If so, the final judgment on 
the effects of time awaits the longitudinal analysis. A further comment is that perhaps time has smell 
or negligible effects on achievement in these studies because it is not measured accurately. In par- 
ticular, one expects time to be important only if it is spent in relevant learning. Thus, observation in 
the class to record the actual time for learning instead of the scheduled time may improve the 
chances of detecting large time-effects. 

The Marginal Effects of Educational Dimensions That Are Not Time-Related 

c 

In addition to time, the educational programs are also described in this study by their operational 
and contextual characteristics. Four such dimensions are examined here: instructional personnel, 
school environment, teacher practices, and organization of classes. These dimensions are measured 
by variables that are not dependent on amount of instruction. The component measures of each 
, dimension are explained below when the effects of the particular dimension are discussed. We first 
examine the effects of each dimension separately and then look into the interrelations among them. 

Characteristics of Instructional Personnel and Achievement Growth. A continuously recurring 
hypothesis regarding what makes a difference in academic achievement is that the critical factors lie 
in the people who deliver the instruction. Aside from the fact that instructors are the most direct 
agents of educational services, this hypothesis has a great appeal when one thinks of the great 
teachers of great people, such as Aristotle and Anne Sullivan. 

Teacher's quality is generally believed to be the important factor of effective teaching. In particular, 
many educators have advocated that the ability of the teacher determines how well his/her students 
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progress academically (e.g., Mood, personal correspondence to SDC). ft is, however, difficult to 
measure the ability of teachers, particularly in a survey study. As substitutes, teacher's qualifications 
such as attainment of academic degrees, training, and teaching experience have been regularly in- 
cluded^ studies of teaching effectiveness and the effects of schooling (e.g., Peck and Tucker, 1973; 
Summers and W_olfer1977). * < 

For the present analysis, five variables are defined on the basis of teacher self-report to describe the 

quality and attitude of the teachers of each student. Additionally, two schooMevel variables are 

used to characterize the cpntacts between students and school staff: staff-to-student ratio and 

support-to-teaching personnel ratio. These two variables are thought to have influences on the 

quality of interaction between instructional staff and students. In sum, seven variables are employed , 

to represent the dimension of instructional personnel. Table 6-2 explains how these variables are 

obtained ffom th£ first-year data and indicates references to Report 9 where detailed descriptions of 

the variables can be found. 
* • 

The simple correlations between these variables and posttest achievement are presented in Table 
F-7 of Appendix F. (Correlations of posttest score with the four student characteristics and the 
variables for oth.er dimensions of education are also provided in this table.} Among the seven 
variables, dealing with instructional personnel, only teacher experience (as indexed. by years of 
teaching) consistently shows a positive correlation with the posttest score, followed closely by 
teacher attitude to school programs (as reflected in his/her subjective feelings of the success and 
- effectiveness of the programs). In both cases, the correlations are small; less than .15 in general. A 
-teacher's education (measured by the highest degree earned), amount of in-service training 
received in recent years, and the ratio of number of staff in the school to total enrollment all cor- 
relate negatively with posttest achievement. Such negative correlations are almost consistent across 
gradesand subjects; but most of them are insubstantial. The other two variables (the teacher's belief 
in schooling as a cause of achievement and the ratio of number of support staff to number of 
teaching personnel) has essentially negligible correlations with posttest score. 

Detailed results of the submodel analysis for this dimension are presented in Table F-8 ofAppendix 
F. The analysis employs a stepwise-regressior* procedure to assess the effects of the seven variables 
representing the characteristics of instructional personnel, with adjustment for pretest and , 
background differences among students but ignoring their differences in other educational dimen- 
sions. The significant variables selected in the submodel analysis are further analyzed with the full- 
model to determine their partial effects that are independent of their relationships with other dimen- 
sions. The results of this full-model analysis are given in Table F-1 2 for reading and F-1 3 for math. A 
summary of the results from both the submodel and the full-model analyses is provided in Table 6-2 
for quick reference. t 

Examination of the summary results in Table 6-2 reveals that experience of the teacher is positively 
related to achievement growth at nearly all grades and in both reading and math. This positive rela- m 

. tionship exists regardless of whether the effects of other dimensions are controlled for or not. The 
consistency of this finding gives us some assurance that the positive ,effect of teacher experience on 
student achievement, although small, is meaningful and not fortuitous. However, it should be noted 
that the finding is at odds with the result of a recent study in Philadelphia (Federal Reserve Bank of 
Ph.'adelphia, 1979), which finds no positive relationship between teacher experience and student 
achievement progress. Hanushek (1970) also found no statisti&lly significant relationship in this 
regard,\vhereas Summers and Wolfe (1977) concluded from their study that there was an interac- 
tion effect between teacher experience and student achievement level. The latter study suggested 
that students who achieved below grade |evel tended to do better* when instructed by less 
experienced teachers, but those who achieved above grade level progressed more when instructed 

" by more experienced teachers. 

• ✓ 

.One may be concerned- that the results of the present study could be merely a consequence of the 
choice of a generous criterion for judging the effects. This concern is alleviated by the fact that 
similar findings are obtained in the phase two analysis where a more stringent criterion (significance 
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Variable 



Variables Describing Characteristics of Instructional Personnel 
and Their Status in th ) Hierarchical Regression Analysis 



Item Content and Interpretation 



Reference to 
Report S 



Preliminary Screening for Znclusioi 
in the Final Analysis for Grade* 



Staff /student ratio 
(ScKool- level) 



Number of school staff divided 
by Student enrollment 



Chapter 8, 
Table 8-27 



R: 
M: 



Support/Teaching 
Personnel ratio 
(School-level) 



Number of support staff (e.g., 
librarians, counselors) divided 
by number of teaching staff 
(e.g., teachers, aides, assis- 
tants) ' , * 



Chapter 8, 
fable 8-27 



R: 
M: 



Years of Teaching 



Number of years *s full-time 
teacher in any school 



Chapter 5, 
Table 5-1 



M; 



Highest Degree 
-Earned 



1 ■ Less than BA; 2 » BA; 3 ■ 
MA or Equivalent; 4 » Ph.D 



Chapter 5, 
Table 5-3 



R: 
Mi 



Recent Inscrvice 
Training 



Total Hours of Inservice Train- 
ing in instruction, received 
during the last 3 years 
(1974-77) 



Chapter 5, 
Table '5-5 



R: 
M: 



Belief in Schooling 



Teacher's rating on the impor- 
tance of instruction as cause 
of achievement 



Chapter 5, 
Table 5-8 



R: 
M: 



Attitude to School 
Programs 



Rating on teacher's positive 
feelings (programs are well 
planned; student needs are met; 
instruction is effective; and 
resources arc sufficient) 
r. — -. — - .V.. ,. , . 



Chapter 8, 
Table 8-7 



R: 
M: 



V 
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Screening of variables is done for Reading (R) and Hath (M) separately and by grades. - 

▲ - indicating that the variable is retained in the fu. 1-model analysis with positive regression coefficient. 
(A full-model analysis considers the background variax>:**. and all variables describing the characteristics 
educational process. Results are presented in Tables F-12 and F-13 of Appendix F) . 

f - same as A except that the regression coefficient is negative. 

A - indicating that the variable is retained in the sub-model analysis with positive regression coefficient, 
but is eliminated in the full-model analysis because of insignificant contribution. (A sub-model analysis 
considers the background variables and the set of variables included in the present table, while omitting 
variables describing other aspects of educational process. Results are presented in Table F-8 of Appendix 
• same as A except that the regression coefficient is negative. 

nk indicates that the variable is eliminated in the sub-model analysis because of insignificant contributio; 
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at the .01 level) is used (see later' discussion in this chapter). It is therefore reasonable to regard our 
results as a confirmation of the common belief that experienced teachers are more effective* than 
the 5 nexperienced ones. Rqwever, exactly how the experienced teachers help their students 
improve achievement remains unclear, because we lack the relevant data to investigate how 
teacher expenence can influence the aspects of instruction that are pertinent to learning. 

The remaining characteristics of instructional personnel rarely show similar effects among grades or 
between reading and.math. The effects of these variables are significant mostly at only one or two 
grades. More important, the direction of tfieir effects frequently changes from one grade to another 
without an interpretable pattern. These results Jead us to suspect that the Variables are not mean- 
ingfully related 1o achievement growth* 

Educational Environment and Ach/evemem Growth. The second dimension primarily deals with 
contextual characteristics of the educational programs. It includes variables describing the condi- 
tions of the school on the basis of the characteristics of its student body; the availability of central 
facilities that help enrich the learning experience of students; instructional atmosphere with regard 
to disturbances caused by fights, violence, or other disruptive behaviors of students; participation of 
teachers, principal, districj staff, parents, and community membersJn the design and implementa- 
tion of programs; and the administrative structure and testing policy of the school district. All of 
these elements ere expected to exert some influence on student achievement as they collectively 
set the environment in which students learn by interacting with each other and with the teachers. 
Just as the work environment in a factory can affect the productivity of workers, the educational 
climate in the school can be conducive or unfavorable to learning and, thus, influence the achieve- 
ment of students. 

Ideally, a thorough understanding of the role of the educational environment in the achievement 
process requires examination of how it influences the proximal aspects of instruction such as 
teacher's conduct in the classroom, the capability of the program to meet the needs of the students, 
and the daily contacts between students through which they stimulate each other to learn. Without 
sufficient data tp make these connections, we settle for a crude assessment of the remote effects of 
environment, disregarding the underlying mechanism that actually produces the effects. 

The 13 variables belonging to this dimension are explained in Table 6-3, which also provides 
references to Report 9 where full descriptions of the variables are given. All of the variables are 
defined at the school level. Four of the variables pertaining to the conditions of the school a'e ob- 
tained from aggregating the characteristics of students in the school: minority concentration, pov- 
erty concentration, concentration of CE students, ard concentration of low achievers. These com- 
position?) variables are interpreted as peer characteristics in some studies (e.g., Summers and 
Wolfe, 1977). Because they are closely related to the nature of interaction between students and 
between students and teachers, they are considered to be important factors in the achievement pro- 
cess. Furthermore, they may also give indication of the richness of resources and educational 
burden of the school. 

School's central resources are believed to be helpful to learning because they provide stimulating 
materials and surroundings. The mobility rate of students affects the stability of the environment for 
learning. Disturbance of instruction caused by fights and violence may district the students and 
teachers, and thus interfere with learning. Active participation a' the school and district staff, and 
parents or community members is expected to improve the quality of instruction and its suitability 
for the needs of the students. Last, the testing policy and the organizational structure of the district 
(e.g., district top-heaviness as indexed by the percentage of administrative staff) may also affect the- 
orientation of service delivery and have some effects on achievement. 

As noted earlier, the simple correlations between these variables and posttest score are presented in 
Table F-7 of Appendix F. None of the variables has consistently positive correlations with the post- 
test, but the four aggregate-variables and disturbance of instruction are negatively and substantially 
correlated with posttest score at all grades and in both reading and math. Correlations between 
posttest score and all other variables are generally small. 

•' ■ '21-- ,84 ' ' 
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Table 6-3 



c Variables Describing Characteristics of Educational Environment 
and Their Status in the Hierarchical Regression Analysis 



Variable 


Item Content and Interpretation 


Reference to 
Report 9 




Preliminary Screening for Inclusion 
in the Final Analysis for Grade* 




1 


2 3 4 5 6 


"School's Minority 
Concentration 


Percent oC students in the 
school who are not white/ 
Caucasian 


None 


R: 
M: 


A 


A A 
AAA 


School's Poverty 
Concentration 


Percent of students in the 
school who participate in free 
or reduced-price meal programs 


None 


R: 
M: 




A A 



School's CE Percent of" Reading/Math CE None R: 

Concentration students in the school M: 



School's Low-Achiever 
Concentration 



Percent of Reading/Math students 
achieving below the 33rd per- 
centile 



R: 
M: 



School's Central 
Resources 



1 - presence of reading/math 
resource center; 0 ■ absence of 
such resource center 



Chapter 8, 
Table 8-12 



R: 
Ml 



Student Mobility Percent of students moving from Chapter 8, 

Rate attendance area plus percent of Table 8-27 

students moving into the area (Also 

in a school vear Table 8-18) 



Parent /Community A measure of the amount of par- 

Involvement . ent and community involvement in 

the school's programs » based on 
? itens from principal and teacher 

questionnaires (e.g., participa- » 
tion in decisionmaking* involve- 
ment in program development and 
£ evaluation , PTA meeting) 



Chapter 8, 
Table V 8-28 
(Also 
Tables 
8-19, 8-20) 



District Control of 


Degree of control that the dis- 












Instruction 


f trict has over the school *s 
programs; based on items from 


Chapter 8, 












Table 8-28 










^ District, Principal and Teacher 


(Also R: A 












questionnaires (e.g., participa- 


Chapter 9, M: * H 












tion in decision-making, control 


Tables 












of allocation of funds, choice 


9-3 to 9-7) 












of texts) 






r 







Principal's Intruc- 
tional Leadership 



Degree to which the principal • 
provides leadership for the' 

school's programs! based on Chapter 8, 

items from Principal and Teacher Table 8-28 

questionnaires (e.g. , .participa- (Also 

tion in curriculum development. Tables 

planning and evaluation, observ- 8-1 to 8-7) 
ing classrooms, and control of 
decision-making) 



Teacher's Involve- 
ment in Decision- 
Making 



The degree of 'involvement 
teachers have in making deci- 
sions related to instructional 
programs (course content, re- 
source utilization, text selec- 
tion, program development and 
evaluation) 



Chapter 8, 
Table 8-28 



Disturbance of 
Instruction 



The amount of disturbance to 
instruction caused by such 
problems as fights, vandalism, 
truancy, and other disruptive 
behavior, based on items from 
Principal and Teacher ques- 
tionnaires 



Chapter 8, 
Table 8-28 



R: 
■M: 



District's Testing 
Program 


1 ■ have district-widey£est£.ng 
« program; 0 * no, such program 


None 


A: 
M: 




f 


District's Percent of 
Administrative Staff 


The percentage of total dis- 
trict staff that is adminis- 
trative 


Chapter 9, 
J Table 9-1 

* 


R: 
M: 


T 


A A 
A 



Screening of variables is done for Reading (R) and Math (M) separately and by grades. A(T) indicates that the 
variable is retained in the full -model analysis with positive (negative) regression coefficient. A(?) indicates 
that the variable is retained in the' sub-model (but not the full -model) analvsis with positive (negative) re- 
gression coefficient. Detailed results of screening are presented in Table? F-9, F-12, and f-13 of Appendix F. 
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The variables representing educational environment are analyzed in two ways, parallel to the sub- 
model and full-model analyses described in the previous section. The results of these analyses are 
summarized in Table 6-3, while Tables F-9, F-12. and F-1 3 in Appendix F provide the detailed results 
from the stepwise procedures. With the exceptions of the four aggregate-variables, the 
characteristics of educational environment contribute little to the explanation of achievement varia- 
tions.. The regression coefficients of these non-aggregate variables generally meet our inclusion 
criterion in three or fewer grades and frequently change sign from one grade to another, indicating 
unstable and therefore not very meaningful relationships between them and achievement growth. 

Among the aggregate variables, concentrations of minority students and low-achieving students 
show consistent relationships with achievement growth in math. In reading, concentration of low- 
achieving students is negatively related to achievement growth in four of the six grades. Similarly, 
the relationships between concentration of low-achieving students in the school and the achieve- 
ment development in math are negative in five of the six grades. On the other hand, concentration 
of minority students is positively related to math achievement growth in four of the six grades. 

However, these results are difficult to interpret because the variables correlate substantially with 
their corresponding variables at the student-level which are also included in the analyses as control 
variables. Thecollinearity between the school aggregate and the respective student-level measure is 
expected as a result of the non-random distributions of students among the schools (i.e., such 
distributions are determined by the parents' choices of residential areas which do not follow a 
random process). Nevertheless, we note that the negative effects of low-achiever concentration 
were also found in Summers and Wolfe (1977). 

In summary, characteristics of educational environment generally do not have systematic relation- 
ships with achievement growth. In particular, principal leadership, which was reported to be 
associated with effective programs in the ESAA in-depth study (Wellisch, MacQueen, Carriere, and 
Duck, 1977), is found here to bear little or no relationship with achievement growth. Perhaps the 
variables in this sjtudy, which are constructed on the basis of the self-reports of the principals and 
teachers, do not reflect accurately the pertinent characteristics of leadership or involvement in the 
programs. 

Educational Practices and Achievement Growth. The third dimension is composed of eight variables 
describing teacher practices in the classroom and in instruction. Teacher practices are regarded as 
the aspect of education that is closest to the process of learning, and are expected to have direct 
influences on achievement. These variables are defined in terms of teachers' self-descriptions of 
what they do in the classes. Each variable is obtained separately for reading and math. Their con- 
struction is explained in Table 6-4 while detailed descriptions of them are provided in Report 9 (see 
Table 6-4 for a guide to the appropriate chapter and tables). 

The simple correlations between the eight variables and posttest score are reported in Table F-7of 
Appendix F. Almost without exception, these correlations are low and rarely bear the same sign 
across grades. Even with these low and inconsistent correlations, some potentially meaningful 
esultsmay still be obtained from thesubmodel and full-model analyses, as presented in Table F-10. 
■A summary of the results is also given in Table 6-4. 

7 

Except for the amount of homework assigned per week, none of the variables representing teacher 
practices shows significant ano consistent relationships with achievement progress in reading at 
more than two grades. This lack of finding with respect to the effects of education on reading 
achievement is common regardless of which dimension is examined. Because of the high correla- 
tion between pretest and posttest scores in reading, the variables in this survey study are mostly not 
sensitive enough to reveal substantial effects on achievement. Amount of homevyork is positively, 
related to growth, but the relationship is weak and significant only at the first two and the sixth 
grades. It is suggested that in order for the homework to be helpful to achievement, it should be 
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Table 6-4 



Variables Describing Characteristics of Educational Practices 
and Their Status in the Hierarchical Regression Analysis 



Variable 


Item Content and Interpretation 


Reference to 
Report 9 




Preliminary Screening 
in the Final An&lysi 


for Inclusion 
s for Grade* 








1 


2 


3 


4 


5 6 


Jul lsjl u ah v*uiiiiwuiuu) 

Development 


NunOucr of hours spent in 
'curriculum development during 
*~ the 1976-77 school year 


Chapter 6, 
Table 6-5 


R: 
M: 


7 








T f 


Effort in Planning 
and Evaluation 


Number of hours spent in 
needs assessment, planning 
and program evaluation dur- 
ing the 1976-77 school year 


Chapter 6, 
Table 6-5 


R: 
M: 


A 








A A 


Teacher's Use of 
Lesson Plans 

- <v **■ 


1 ■ lesson plans are used in 
instruction; 0 ■ classroom 
activities dictated by student's 
interest and expressed need, no 
lesson plans 


Chapter 6, 
Table 6-5 


R: 
M: 


L 
T 








A 

A V 


Frequency of Feed- 
back per Semester 


Number of times the teacher 
provides feedback (grade,, 
strength, or weakness) to the 
student in a semester 


Chapter 6, 
Table 6-8 


R: 
M: 


A 




A 


A 


A 
A 


Weekly Homework 
Assigned 


Average hours of homework 
assigned to the student in 
a week 


Chapter 6, 
Table 6-14 


R: 
M: 


A 

A 


A 
A 


V 


A 


A 
A 



Monthly Use of Number of times per month the 



Materials 


teacher uses materials (e.g., 
textbooks, reference books, 
dittos) in instruction 


Chapter 6, 
Table 6-17 


R: 
M: 




A 




A 




Indi v idual ization 


The extent to which the teacher 


Chapter 6, 














of Instruction 


uses individualized approach in 


Table 6-18 
















instruction (individual izat ion 


(invididual 


R: 








T 






is indicated b/ differences in 


items in 


M: 


V 




T 


T 


A 




aspects of instruction for dif- 


Tables 6-9 
















ferent students) 


thru 6-13) 














Monthly Use of Audio- 
Visual Equipment 


Total number of times per month 
the teacher or student uses 
Audio-Visual equipment (e.g., 
TV, projectors, viewers, study 


Chapter 6, 
Table 6-18 


R: 
M: 


A 




A 


T 


T 



carrel) m instruction and 
, learning ** 

*Screening of variables is done for Reading (r) and Math (M) separately and by grades. 

A - indicating that the variable is retained in the full-model analysis with positive regression coefficient, 
f - same as A except that the regression coefficient is negative, 

A - indicating that the variable is retained in the sub-model analysis with positive regression coefficient, 
but is eliminated in the full-model analysis for lack of contribution. 

V - same as £ except that the regression coefficient is negative. 

Blank indicates^hat the variable is eliminated in the sub-model analysis for lack of contribution. 
Detailed results of the screening are presented in Tables F-10, F-12, and F-13 of Appendix F. 
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relevant and the student has to work on it faithfully. Thus, studies using a more refined measure of 
time spent in doing homework may reveal greater effects. Such a conjecture clearly requires 
verification with future data. 

The picture in math is clearer than that in reading. The positive effect of amount of homework on 
math achievement receives support fairly consistently (in four of the six grades). In addition, the 
more frequerttly the teacher provides feedback to the students concerning their progress, the better 
they perform in math. This positive relationship is shown in five of the six grades. Contrary to expec- 
tation, individualization of instruction does not have significant effects on reading achievement, 
while it shows a negative relation to achievement progress in math at three grades. Similarly, the 
amount of time teachers spend in curriculum development is also negatively related to math 
achievement growth. 

Although the negative effects of individualization on math achievement are small, the finding is 
somewhat disturbing. A possible reason may be that the measure of individualization does not pro- 
perly reflect the features that are helpful to learning. Specifically, individualization is important and 
useful if it fits the need of the students and the best method for each student is adopted. In this 
report, the variable representing individualization reflect* largely the degree of differences between 
teacher treatment of low-achieving and regular-achieving students and the use of subgroups in 
instruction. As such, the variable does not describe the nature of the different treatments and can 
not differentiate whether individualization is achieved according to student need. Consequently, 
the actual effects of individualization may not be revealed in the analysis. Further improvement of 
the variable is required to clarify this issue. 

In short, most of the characteristics of educational practices under consideration do not show 
appreciable impacts on learning, particularly in reading. This finding obviously does not meet our 
expectation. Nevertheless, the discouraging result agrees with that of Cooley and Leinhardt (1978) 
who conclude that "the more important consideration is what gets taught rather than how it's 
taught." We regard such a conclusion as a bit premature, and remain hopeful that when better data 
are available, effective practices for improving achievement can be discovered. 

Organization of Classes and Ach/evement Growth. The last dimension examined is concerned with 
the organization of classes for instruction. Only three variables are obtained to represent this dimen- 
sion. These are described in Table 6-5, which also indicates the appropriate references to Report 9 
for the variables. 

While the extent of ability grouping indicates how students are tracked for the purpose of class 
instruction, it does not provide information about whether the resulting classes are homogeneous 
or not with respect to achievement level. Such information is obtained from an item in the Student 
Background Checklist which asks the homeroom teacher to rate the achievement level of students 
in the class. The data are translated into a dichotomous variable showing whether the achievement 
levels of the students are generally similar or different. 

r 

Additionally, because class size has received ample attention in educational research (see, for 
example, Glass and Smith, 1979), it is also included in this study although the Student Participation 
ancl Attendance Record also supplies data regarding the size of groups for instruction. Class size is 
believed to be important in education because it can affect the amount of interaction each student 
has with the teachers and also because it is closely related to program expenditures. 
I 

The correlations between these three variables and posttest score are mostly small and of inconsis- 
tent signs over the grades, as can be seen from the bottom section of Table F-7 in Appendix F. In 
reading, except for a negligibly negative correlation at grade 1, there is an almost systematic trend 
for the positive correlations between class size and posttest score to increase with grades; at the 
upper three grades, the correlation becomes appreciable. The corresponding correlations in math 
are smaller by comparison. 
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Table 6-5 



Variables Describing Characteristics of Classroom Organization 
and Their Status in the Hierarchical Regression Analysis 



1 

Variable r 


Item Content and Interpretation 


Reference to 


Preliminary Screening for Inclusioi 
in the Final ^Analysis for Jratie 1 






1 


2 3 4 5 6 


Classroom Achievement 
Level 


Teacher's report on the achieve- 
ment level of students in the 
class. 1 = different among 
students; 0 = similar 


Chapter 4, R: 
Table 4-7 M: 




. A 

A V 



Extent of Ability 
Grouping (School- 
level) 



The degree to which students 
are grouped or tracked by 
ability level. The composite 
is based on principal's and 
teacher's answers concerning 
how students are assigned to 
classes 



Chapter 8, R: 
Table 8-28 M: 



Class Size 



Teacher's estimate of number of 
students in the class (average 
over all teachers for the 
student) 



•Chapter 6, 
'Table 6-3 



R: 
M: 



Screening of variables is done for "Reading (R) and Math (M) separately and by grades. 

A - indicating that the variable is retained in the full-model analysis with positive regression coefficient, 
f - same as A except that the regression coefficient is negative. 

A - indicating that the variable is retained in the sub-model analysis with positive regression coefficient, 
but is eliminated in the full-model analysis because of insignificant contribution. 

V - same as A except that the regression coefficient is negative. 

Blank indicates that the variable is eliminated in the sub-model analysis for lack of contribution. 
Detailed results of the screening are presented in Tables F-ll, F-12, and F-13 of Appendix F. 
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The results of the analyses for this dimension are presented in Tables F-1 1, F-12, and F-13 of Appen- 
dix F, and are also summarized in Table 6-5. This table clearly reveals that the variables rarely show 
non-negligible ef'acts _on reading achievement. Howeve r , in math, students attending smaller 
classes tend to progress more at grades 2 and 3. Note that the regression coefficients for class size 
arenegat/ve, indicating that smaller class size relates to greater growth. 

The reader may recall that the simple correlations between class size and posttest score are slightly 
positive, implying higher-achieving students tend to be assigned to larger classes. Such positive cor- 
relations can in part be explained by use of smaller classes for compensatory-education students 
than for regular students (see Report 5). However, after adjusting for pretest and background dif- 
ferences, the effects of class size become either negligible or slightly positive in math. 

The lack of effects of class size on reading achievement was also noted in a recent study by Shapson 
and his colleagues (Shapson, Wright, Eason, ^nH Fitzgerald, 1980). They suggest that because 
instruction is frequently provided in subgroups within class, particularly in reading, class size 
becomes less important than expected. The results of previous analysis (see Reports 5-and 9) indeed 
indicate that reading teachers form subgroups for instruction much more frequently than math 
teachers. For this reason, we suspect that if group size affects learning, it would be more appropriate 
to examine such effects in terms of the size of instructional groups. In this respect, we note that 
earlier analysis of the effects of time spent in groups of different sizes does not produce any better 
results. 

Another comment on the effects of class size is that while it is commonly believed that smaller 
classes would allow the.teachers to interact more intensely with the students and therefore be more 
effective in teaching, this need hot happen in reality. The experimental study by Shapson et al. 
found that although teachers generally felt the benefit of reducing class size, there was little 
evidence that they actually changed the way they interacted with students, the time they allocated 
to individual student work, or their instructional styles or methods. Consequently, the study also did 
not find appreciable improvement in student performance that was attributable to small classes. We 
think that the class size in this study as reported by the teacher can not be expected to make a dif- 
ference in student progress unless some changes also take place to make the instruction more effec- 
tive when clases become smaller. 

Over the years, there are numerous studies on the effects of class size. As cited in Summers and 
Wolfe (1977), Blake (1954) conducted a survey review of research on class size and reported more 
evidence for the effectiveness of smaller classes than of larger classes, but he also noted many 
inconclusive results. Most recently, Glass and Smith (1979) performed a meta-analysis of the effects 
of class size based on the results reported in about 80 studies. They concluded that smaller class size 
had a dramatic effect on improving academic achievement. While their conclusion is very encour- 
aging and welcomed by the education community, we are very cautious in accepting its face value 
because the analysis is flawed and the interpretation is misleading. (Perhaps * he authors are too anx- 
ious to refute the 'disheartening' conclusion of Powell's Report that smaller classes need not be ex- 
pected to result in greater academic achievement.) 

Despite the claim by Glass and Smith, we believe that our results showing small or no effects of class 
size are in agreement with many recent studies. For example, Cooley and Leinhardt (1978) in a 
similar evaluation study reported a lack of consistent relationship between class size and achieve- 
ment. Summers and Wolfe (1977) found some interaction effects between class size and achieve- 
ment level. They reported that classes larger than 28 students could'have perverse effects on learn- 
ing for low-achieving students. Additionally, the experimental study of Shapson et al. was also 
unable to find large effects of class size. On the basis of our analysis and the results of other studies, 
it is reasonable to conclude that reducing class size sometimes helps improve student performance, 
in math particularly, but the effects are not as substantial as might be expected. 

Interrelations Among the Dimensions. We now compare the results obtained in the submodel and 
full-model analyses in order to examine the role of the interrelations among the four dimensions of 
program characteristics in producing their effects on achievement. From Tables 6-2 to 6-5, we find 
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that most of the variables selected with the submodel analyses are retained in the full-model 
analyses. Furthermore, comparison of the data given in Tables F-8 to F-1 1 for the submodel analyses 
with those in Tables F-1 2 and F-1 3 for the full-model analyses, reveals that the magnitudes and the 
directions of the effects for the selected variables in the full-model are very similar to those 
estimated in the initial submodel analyses. These results suggest that the collinearities between the 
. dimensions are not a serious problem. Indeed, the intercorrelations among the educational 
variables are generally small, and the tolerance of each variable remains high as other variables are 
introduced into the model. (The relatively lower tolerances for the aggregate-variables, which 
describe educational environment, are a result of their correlations with the background variables 
rather than of their relationships with other educational variables.) 

The squared multiple correlations resulting from the submodel and full-model analyses are 
presented in Table 6-6. As shown in this table, the full-model and each of the four submodels 
examining the four dimensions separately result in practically identical multiple correlations, 
especially in the reading analyses. This result suggests not only that each educational dimension has 
very small uniqu^contribution to the variations of achievement, but also that the interrelations 
among them play a negligible role in explaining the achievement differences among students. 

Additionally, it may be noted that the four aspects of the characteristics of educational process col- 
lectively have very modest relationships with achievement growth. The squared correlation 
v between pretest and posttest scores are also given in Table 6-6 to serve as references for judging the 
K amounts of additional contribution to achievement variations by the background and educational 
variables. The increments in the proportion of posttest variances accounted for by adding the 
background and educational variables are 7.1, 4.0, 2.8, 0.9, 1.4, and 1.1 percent in reading for 
grades 1 to 6, respectively. (These values can be obtained by taking the differences between the first 
two columns in Table 6-6.) The corresponding increments in math are 4.0, 4.0, 7.9, 3.3, 2.2, and 2.1 
percent. Further inspection of the increments of R2 as each of the background variables is intro- 
, duced in to the model (Tables F-8 to F-1 1 ) indicates that these increments are largely attributable to 
the contribution of background variables. In the next section, we will further examine the joint rela- 
tionships of the educational variables with achievement growth by analyzing the data from the 
whole sample. 

Conclusion. On the basis of the exploratory analysis, we conclude that the characteristics of educa- 
tional process as described in this study do not substantially help us understand what influences stu- 
dent achievement growth. This conclusion, while frustrating, is not different from the common 
situation encountered in studies that address the general issue of the effectiveness of schooling. 

THE RELATIONSHIP BETWEEN THE EDUCATIONAL PROCESS 
AND BASIC-SKILL ACHIEVEMENT 

The preceding anal/sesdeal with the educational dimensions in a sequential manner (i.e., examin- 
ing each dimension separately and then jointly) in order to aid our understanding of hpwthe educa- 
tional process is related to achievement growth. The analyses use a random sample of only 15 per- 
cent of the first-year data and have not considered the instructional time and the operational 
.characteristics of the programs together. On the basis of these preliminary analyse:,, we can select 
for futher analysis only those characteristics of the educational process that have potentially mean- 
ingful relationships with achievement. The variables so selected constitute the basic model for our 
phase-two analysis concerning the relationships between education and achievement develop- 
ment. 

In essence, the model for the present analysis includes as independent variables the pretest score, 
the four student, characteristics, the three composites of instructional time, and the educational 
variables that meet the selection criterion at the last step of the phase-one analysis. The educational 
variables selected to represent the four operational dimensions of education are indicated in Tables 
6-2 to 6-5 by darkened triangles (AorV). The dependent variable in the model is the posttest score. 
This model is applied to analyze the entire first-year data in order to validate the results of the earlier 



ERIC 



Table 6-6 

Coefficients of Determination (Multiple R 2 ) for the Full-Model and the 
Four Submodel Regression Analyses to Examine the Effects of Characteristics 
of Educational Process on Achievement Growth 



Squared Submodels* - Characteristics of 

Pretest- Full ; 

Post test Model* Instructional Educational Educational Classroom 
Correlation* Personnel Environment Practices Organization 



Reading 



1 .438 .509 .490 .49C .488 .481 

2 " .636 .676 .673 .674 .672 .671 

3 .707 .735 .729 .733 .726 .726 

4 .769 .778 .777 .777 .776 .776 

5 .800 .814 .810 .811 .811 .809 

6 .809 .820 .818 .817 .818 .816 



Math 

1 .445 .485 .478 .477 .480 .473 

2 .525 * .565 .555 .553 * .551 .548 

3 .538 .617 .578 .612 .580 .576 

4 .593 .626 .610 .616 .615 .609 

5 .655 .677 .668 .674 .667 .664 

6 .679 .700 .694 .691 .695 .690 



A full-model considers the four aspects of educational process concurrently to 
examine their partial effects, while a submodel considers each aspect separate- 
ly to assess the marginal effects. Detailed results of the full-model analyses 
are presented in Tables F-12 and F-13 in Appendix F and results of the sub- 
model analyses are presented in Tables F-8 to F-ll. The squared correlation 
between pretest and posttest can be found in Table F-8. All results are based 
on analyses of the 15 percent random samples. 



exploratory analyses regarding the effects of the educational variables. Additionally, commonality 
analysis of the posttest variance is performed based on this model to assess the role of education in 
the academic development of students. 

The Partial Effects of Program Characteristics on Achievement 

The results of the rpultiple regression analysis with the selected model are presented in Table 6-7 for 
reading and Table 6-8 for math. For both reading and math, pretest achievement always makes the 
largest unique contribution to the prediction of posttest achievement, usually followed by teacher s 
judgment of need for compensatory services. By comparison, the unique contributions of the ^ 
educational variables are all very small. 
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Table 6-Z \ 

Regression of Reading Posttest Score on Pretest Score, Characteristics of Student Background, 
Instructional Services Received, and Selected Characteristics of Educational Processes 
(Based on the Entire Sample of the First-Year SES Data Base) 



1 






Unique Contribution to Squared Multiple Corre) 


ution (R 2 


<u>># 






Variables Employed in the 






and Standardized Regression Coefficior.c 


(Beta)* 






Multiple Regression Model 




















for the Prediction of Reading 


Grade 1 


Grade 2 


Grade 3 


Grade 4 


Grade 5 


Grade 6 


Achievement Posttest Score** 




















K IUJ 


Beta 


R 2 (U) Beta 


R 2 (u) Beta 


R 2 (U) Beta 


R z (U) 


Beta 


R (U) 


Beta 


Background variables 




















Pretest VSS Score 


.189 


.522 


\ .247 .662 


.255 .716 


.335 .787 


. 3 1 3 


.8.7 


. 384 


.838 


White/Minority status 


< .001 


(-.005) 


nnl niQ 

• UUl . UJ7 


< nnl / nnci 

s . UUl \ .UUDJ 


nnl nAt 
.UUl .U4« 


m* .001 




*? nm 
* . UUl 


.029 


Free Lunch Participation 


.001 


-.046 


.001 —.047 


< nn l f_ nl 1 1 
v . UU 1 l"". uii I 


*? nnl — mc 
^ . UUl — . U«D 


• 001 


— .042 


< .001 


~.U*D 


Teacher's Judgment of CE Need 


.027 


-.203 


.008 -.116 


r\r\A — nm 


nn7 mm nnc 


• 002 


• UOU 


.002 


-.031 


Mother's Educational Attainment 


.004 


.070 


.001 .039 


•001 .041 


nnl nv. 

« UUl • U 


• UUl 


.028 


.001 


.026 


Instructional Services Received 




















Regular Instruction 


.002 


.050 


.001 .026 ' 


<.00l (-.000) 


<.00l (.005) 


.001 


.029 


<.00l 


(.006 


Special Instruction 


<.00l 


(.017) 


<.00l -.022 


<.00l -.023 


<.00l (-.007) 


<.00l 


(.010) 


<.00l 


(-.002 


Tutor/Independent Work' 


.001 


.031 


<.00l (-.006** 


<.00l (-.001) 


<.00l (.013) 


<.00l 


(.011) 


<.00l 


(.009 


Characteristics of Educational Processes 




















Staff/Student Ratio 


NA 




NA 


< nnl t nnQl 

% . UUl V . UU7 J 


NA 


NA 




NA 




Support /Teaching Personnel Ratio 


NA 




NA 


NA 


NA 


NA 




* . ool 


-.015 


Years of Teaching 


.003 


.053 


.003 .056 


< nnl ( nn.71 


.001 .024 


< ool 


nl o 

• UlO 


NA 


Highest Degree Earned 


NA 




NA 


< nn l m ^ 


NA 


NA 




NA 




Recent Tnservice Training 


< .001 


(-.006) 


NA 


NA 


NA 


NA 




< . 001 


.022 


Attitude to School Programs 


NA 




< nnl (- nnn) 


NA 


NA 


NA 




NA 




School's Minority Concentration 


NA 




NA 


NA 


nnl nic 
.uui . u j b 


NA 




NA 




School's CE Concentration 


.002 


.046 


.002 .051 


NA 


NA 


NA 




NA 




School's Low-Achiever Concentration 


NA 




.002 -.071 


nnR — i nn 


NA 


NA 




< .001 


-.016 


School's Central Resources 


< m Q0l 


. 024 


NA 


NA 


NA 


NA 




NA 


Parent /Community Involvement 


<.00l 


-.024 


NA 


NA 


NA 


<.00l 


.013 


NA 




District Control of Instruction 


<.00l 


(.016) 


NA 


NA 


NA 


KA 




NA 




Principal's Instructional Leadership 


<.00l 


.022 


NA- 


<.00l -.019 


NA 


NA 




.NA 




Disturbance of Instruction 


<.00l 


.024 


NA 


NA 


NA 


<.00l 


-.022 


NA 




District's Percent of Administrative Staff . 


NA 




<.00l -.021 


<.001 .017 


NA 


NA 




NA 




Effort in Planning and Evaluation 


NA 




NA 


NA 


NA 


<.00l 


.017 


NA 




Teacher's Use of Lesson Plans 


<.00l 


(.002) 


NA 


NA 


NA 


NA 




<.003 


(.007) 


Frequency of Feedback per Semester 3 


NA 




NA 


NA 


NA 


NA 




-<.oor 


(.004) 


Weekly Homework Assigned 


.001 


.035 


NA 


NA 


NA 


NA 




<.00l 


.012 


Monthly Use of Materials 


NA 




NA 


NA 


bh 


<.00l 


(,005) 


NA 




Individualization of Instruction 


NA 




NA 


NA 


NA 


<.00l 


-.012 


NA 




Monthlv Use of Audio-Visual Equipment 


<,001 


(.009) 


<.00l (-.015) 


NA 


NA 


<.00l 


-.012 


NA 




Classroom Achievement Level 


NA 




NA 


NA 


NA 


<.001 


(.006) 


NA 




R 2 for the Regression Model 


.475 


.671 


.734 


.756 


.810 


.820 


• 

Regression coefficients that are not significantly different 


from zero at the .01 level are enclosed in parentheses. 








Onlv the subset of educational-process variables selected in the preliminary analyses with a 15 


percent random sample was employed in the preser 


v >es. NA indicates that the variable is 


not included in the analysis as a 


result of the preliminary screening. 
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Table 6-8 

Regression of Math Posttest Score on Pretest Score, Characteristics of Student Background, 

Instructional Services Received, and Selected Characteristics of Educational Processes 
^ (Based on the Entire Sample of the First-Year SES Data Base) 



Variables Employed in the 
Multiple Regression Model 
for the Prediction of Math 
Achievement Posttest Score** 



Unique Contribution to Squared Multiple Correlation (R 2 (U)), 
and Standardized Regression Coefficient (Beta)* 



Grade 1 



Grade 2 



Grade 3 



Grade 4 



Grade 5 



Grade* 6 



Background Variables 
Pretest VSS Score 
White/Minority status 
Free Lunch Participation 
Teacher's Judgment of CE Need 
Mother's Educational ^Attainment 



R*(U) Beta r2< U ) Beta R? (U ) Beta R*(U) Beta ? *<U) Beta R* (U) Beta 



.238 .567 
<.001 (-.000) 
<.001 -.024 
.019 -.161 
.001 .038 



Instructional Services Received 
Regular Instruction 
Special instruction 
Tutor/Independent Work 



.270 .611 
.002 .069 
<c.00r (-.020) 
.012 -.126 
.001 .041 



.220 
.001 
.001 
.011 
.001 



.564 
(.021) 
(-.015/ 
-.128 

.039 



.292 
<.001 
<.001 
.007 
.001 



.68? 
(.02i) 
(-.010) 
-.102 

.043 



.315 .701 

.001 (.012) 

.002 -.052 

.005 -.086 
.001 .016 



.391 
<,001 
<.001 
.004 
.001 



.753 
.027 
-.026 
-.077 
.033 



.001 (-.015) 
.001 (.012) 
.001 .025 



<.001 (-.005) 
<.001 (-.018) 
<.001 (-.013) 



.001 
.001 
.001 



-.011) 
-.026 
(.010) 



<.001 
.001 
c.001 



(.005) 
.042 
(.011) 



.001 
.001 
.001 



.031 

.001) 

.019 



<.001 .018 
<.001 (-.003) 
<.001 (-.005) 



Characteristics of Educational Processes 
Support/Teaching Personnel Ratio - 
Years of Teaching 
— Recent lnservice~Training 
Belief in Schooling 
Attitude to School Programs 



School's Minority Concentration 
School's Poverty Concentration 
School's CE Concentration 
School's Low-Achiever Concentration 
School's Central Resources 
Parent/Community Involvement 
Principal** Instructional Leadership 
Teacher's involvement in Decisions 
Disturbance of Instruction 
District's Testing Program 
District 's Percent of Administrative staff 
Effort in Curriculum Development 
Teacher's Use of Lesson Plans 
Frequency of Feedback per Semester 
Weekly Homework Assigned 
Monthly Use of Materials 
Individualization of Instruction 
Monthly Use of Audio-Vi ?V Al r ^irxr-ent 
Extent of Ability Grouping 
Class Size " 



NA 

<.001 .023 
<.001 (-.003) 
.001 .033 
MA 



-.C34 
.028 



NA 

NA 

NA 
.001 
.001 

NA 

NA 

NA 

NA 

NA 

NA 

NA 

<.001 (-.006) 
NA 
.001 
NA 
NA 
NA- 



NA 
.004 

NA 

NA 

NA 
.001 



.065 



NA 
NA 
.001 
NA 
NA 



.027 



NA 
NA 
.002 -, 
NA 

<.001 (, 

'4 

<.o$i <-, 

NA 
NA 
NA 



.072 

067 
006) 
007) 



NA 
<.001 
<.001 
NA 
NA 



(.014) 
(.009) 



.002 

NA 

NA 
.022 - 

NA 

NA 

NA 

NA 

NA 
.001 (- 
.G01 



.001 
.001 

NA 

NA 
.001 



(.003) 
.025 



.016 



.237 



.008) 
.033 



.001 

NA 
.001 
.003 

NA 

NA 
.001 

NA 

NA 

NA 

NA 



.061 



-.034 
-.091 



(-.012) 



.001 v -.032 
.001 .016 
NA 

.001 -.019 
NA 



.029 



NA 
NA 
NA 
.A01 
.001 
NA 
NA 



.031 
.030 



NA 

NA 
.001 

NA 

NA 
.002 
.001 (. 



NA 
.001 

NA 
.004 

NA 
.001 

NA 
.001 
.001 

NA 

NA 



.063 

.108 

.028 

.017 
.042 



NA 
.001 
NA 
NA 
NA 
NA 
NA 
NA 
NA 
NA 
NA 



(-.002) 



024 



NA 
NA 



044 
013) 



NA 

NA 
.001 
.001 

NA 
.001 

NA 



t.014) 
(.016) 

-.027 



NA 

<.001 (- 



009) 



NA 
.001 



(-.004) 



.001 
NA 



.091 (- 
.001 
NA 
NA 
NA 
NA 
NA 



.001) 
.018 



- 017 



<.001 (-.006) 
NA 

.001 .032 

.001 .033 
NA 

.001 .035 

<.0Q1 (-.012) 



NA 
NA 



R 2 for the Regression Model 



NA 
NA 



.465 



.538 



.592 



.630 



.666 



.685 



ERIC 



^ ssion coefficients that are not significantly different 

the subset of educational -process variables selected in 
MA indicates that the variable is not included in 



from zero at the .01 level are enclosed in parentheses., 

the preliminary analyses with a 15 percent random sample was employed in /the present 
the analysis as a result of the preliminary screening. ^ n C/ 

► , ^2 _^o_ 



Comparing the standardized regression .coefficients for the educational variables in Table 6-7 with 
those in Table F-12 (of Appendix F), it is found that the corresponding coefficients are mostly of 
same sign and comparable magnitude. This finding in part provides a cross-validation of the model 
because the analyses reported in these two tables use different samples. (The entire first-year sample 
is^used in the analyses reported in Table 6-7, while the analyses reported in Table F-12 use only a 15 
percent random sample from the first-year data.) Furthermore, the two analyses also differ in that 
the results of Table F-12 are obtained from analyses that omit the time dimension and some non- 
contributing student characteristics. Thus, the above comparison between the data in these two 
tables also suggests that there are no serious distortions of the effects of education inferred from the 
exploratory analyses. This means that the partial effects of the educational variables, adjusting for 
the differences among students with respect to other educational aspects, remain similar to what we 
have discussed earlier. For this reason, we will not repeat the results of Table 6-7 here. Similar 
remarks apply to the findings for math when the results reported in Table 6-8 and F-13 (see Appen- 
dix F) are compared. 

With regard to the effects of instructional time, there are few new findings in these final analyses. 
Generally, only the amount of regular instruction shows positive effects on achievement. Because 
the effects of time have been extensively discussed in previous chapters and in the earlier section, 
we will not reiterate the findings in Tables 6-7 and 6-8. 

I 

'In summary, the latest analyses with data for the whole sample and with the selected model recon- 
firm our earlier conclusions that there are few systematic and substantial effects of the educational 
process. Amount of instruction does not prove to be very critical in explaining the achievement dif- 
ferences among students. Among the program characteristics, only the experience of teachers is 
consistently 5hown to have a positive relationship with achievement growth. The results presented 
in Tables 6-7 and £-8 will be reviewed further in Chapter 7 with an emphasis on the similarities and 
dissimilarities among grades. 

The Role of the Educational Process in Achievement Growth 

In order to assess the joint relationship between the educational dimensions and achievement 
growth, the posttest variance explainable by the model is partitioned into components that are 
unique to sets of background and educational variables and that are shared by combinations of 
these sets. The independent variables in the model are divided into three sets for this purpose: 

• Set A. Pretest and Background Variables, This set contains the pretest score and the four stu- 
dent characteristics (judged need for compensatory services, mother's education, family 
economic status, and white minority status). 

• Set 8. Instructional Services. This set is composed of the three composites measuring the 
amounts of time spent in regular instruction, special instruction, and tutor/independent 
work. 

• Set C. Educational Process. This set consists of the variables representing the four dimensions 
of education that describe the program characteristics and are not time related. 

The results of the commonality analyses are summarized in Table 6-9. The contribution unique to 
Set A is always much larger than that for any other set or that shared by any combination of sets. The 
total contributions of pretest and background variables (obtained by adding up the components that 
include Set A) by grade are: .46, .66, .73, .75, .81, and .82 for reading; and .46, .53, .56, .62, .66, 
and .68 for math. 

The proportion of posrtest variance that is uniquely accounted for by sources other than pretest and 
student characteristics can be obtained by subtracting the total contribution of Set A from the 
squared multiple correlation for the model (given in the last line of each section in Table 6-9). These 
contributions are remarkably small, almost always less than 1 percent. However, there are apprecia- 
ble contributions that are shared between the educational variables, and the pretest and 
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1 Table 6-9 



Partition of the Posttest Score Variance Accounted for by Pretest Score and Student Background 
Characteristics. (A), Instructional Services deceived (B), 
* and Characteristics of Educational Processes (Q* 



Components of Variance Proportion of Posttest Score Variance Accounted 

A ■ Pretest and Background for by the Disjoint Components of Variance 



B 88 Tn^t" met* 1 onal Qortn'roc 

C * 4 Educational Processes Grade 


1 




2 




3 




4 




5 




6 




Reading Achievement N 


10,746 




10,372 




10,771 




10,672 




10,559 




11,649 




Unique to A** 


.4045 


(5) 


.4214 


(5) 


.4208 


(5) 


.5629 


(5) 


.6434 


(5) 


• 5628 


(5) 


Unique to B** 


.0024 


(3) 


.0015 


(3) 


.0003 


(3) 


.0002 


(3) 


.0005 


(3) 


.0001 


(3) 


Unique to C** 


.0080 


(11) 


.0068 


(6) 


.0063 


(6) 


.0011 


(2) 


• 0014 


(8) 


.0009 


(6) 


Shared by A and B But Not C 


.0283 




.0616 




.0743 




.0966 




.0650 




.0486 




Shared by A and C But Not B 


.0179 




.1597 




.1776 




.0652 




.0541 




.1485 




Shared by B and C But Not A 


.0005 




.0002 




.0001 




.0000 




.0001 




.0001 




Shared by A, B, and C 


.0133 




.0201 




.0548 




.0298 




.0458 




.0592 




Squared Multiple Correlation 


.4749 




.6713 




.7342 




.7558 




.8103 




.8202* 





Hath Achievement 


N 


10,605 




9,965 




10,117 




9,483 




11,016 




11,500 




Unique to A** 




.3676 


(5) 


.3881 


(5) 


.3457 


(5) 


.4532 


(5) 


.4667 


(5) 


.5597 


(5) 


Unique to B** 




.0011 


(3) 


* .0004 


(3) 


.0008 


(3) 


.0015 


(3) 


.0009 


(3) 


.0004 


(3) 


Unique to C** 


w 


.0038 


(7) 


.0089 


(8) 


.0297 


(9) 


.0074 


(10) 


.0094 


(10) 


• 0042 


(9) 


Shared by A and B But Not C 




.0110 




.0115 




.0132 




.0115 




'.0228 




.0231 




Shared by A and C But Not B 




.0644 




.1096 




.1532 




.1356 




.1396 




'.0744 




Shared by B and C But Not A 




-.0004 




.0002 




.0027 




-.0005 




..0002 




.0001 




Shared by A, B, and C 




.0176 




.0190 




.0468 




.0212 




.0263 




.0232 




Squared Multiple Correlation 




.4651 




.5377 




.5921 




.6299 




.6659 




.6851 





* *» 
The analyses used the whole sample of the first year (1976-77 school year) ♦ Cases with missing values for any of the 
variables involved were excluded. The pretest score, yearly hours of instructional services received, and character- 
istics of educational processes are subject -specific measures with the exceptions of some school- level variables. The 
student background variables are common for reading and math except for teacher* judgment of CE need. The educational 
process variables employed in the analyses for reading and math are listed in Tables 6-7 and 6-8, respectively. 

•* 

The number, in parentheses indicates the number of predictors contained in the variable set. 



.background variables. These results suggest that the educational process does not independently 
explain the achievement differences among students, but may have some influence on achieve- 
ment growth that is not separable from its relationships with student backgrounds? » 

#; '» • 

On the basis of these results, we conclude that the educational process assumed rather modest 
role in achievement development. The differences in the educ^ional experiences of the students 
*with respect to the characteristics considered in this study are not important in explaining the dif- 
ferences in their achievement progress. This could suggest that the relevant aspects of education ar* 
"not validly represented in the analysis. At the same time, it could also suggest that the existing pro- 
grams are just not sufficiently different from one another so as to make notable differences in the 
outcome. 

THE INFLUENCE OF INSTRUCTIONAL STAFF, ENVIRONMENT, AND 
PRACTICES ON STUDENT ATTITUDE 

» * 
Aside from achievement in basic skills, another important aspect of educational development con- 
cerns the attitudes of students toward learning and school. Although educators tend tp believe that, 
student attitudes can affect their learning, it is equally plausible that\how well the students do can 
affect their feelings about learning and their liking of school. Furthermore, how well the students do 
in school and how they feel about schooling can both be influenced by thjeir educational experi- 
ences. Thus, it is of interest to study how student attitude, achievement, and educational experi- 
c ences interrelate with one another. 

Previous analysis revealed that the correlation between achievement and student attitude as 
measured by the Student Affective Measure (SAM) was negative and small (see Report 9). The stu- 
dent affect score was found to have loto reliabilities, and there was a concern that students, 
minorities and low achievers in particular, might be inclined to give socially desirable responds to 
the items in the SAM and consequently the validity of the measure mighf be questionable (see 
Reports 5 and 9). Additionally, there are also concerns that many items in thfe test appear toliave 
ambiguous interpretations and that the presentation of the response alternatives migjit encourage 
positive responses. With these considerations, we do-not expect the analysis or the student affect t 
scores to produce clear results. Indeed, the analysis in Chapter 2 did not find any meaningful effects 
of compensatory services on student attitude. The changes of attitude during the school year, for 
the most part, appears to be trivial. For these reasons, we decided not to expend much effort in the 
examination of the relationships between attitude and achievement. However, exploratory analyses* 
are performed to provide information on how the educational process might be related to the 
development of attitude. „ \ 

Among the five dimensions of education studied in. basic-skill development, three are considered Jo 
have possible influences on studem attitude: instructional personnel, educational environment, and 
teacher practices in the class. These three dimensions could affect the contacts among students and 
the interaction between teachers and students so that they woi/ld also be related to how students 
like school and learning. The analysis strategy used in the phase-one analysis of the relationships' 
between basic-skill achievement and education is adopted for the present'investigation. However, 
because separate analyses of the 'three dimensions produced* no noteworthy findings, it. was" 
decided not- to proceed to the joint analyses of them. • > • 

The total student affect score is used as the only measure of attitu* becarte the intercorrelations 
among the three subscales aYe very high, relative to their reliabilitiq*(see Report 9). The educational 
variables for both the reading and math programs are used togetheNto represent each of the j|>ree 
•dimensions. These variables were explained previously in Tables 6-2 to^-4. As there ar<e few mean- 
ingful findings from these anaiyses, their results are presented in AppeMix F. * * \ . < 

The simple correlations between the posttest score, student characteristics, and the educational 
variables and the posttest score are given in Table F-14. Theser correlations.are generally small> 
Among the educational variables, only the concentrations of minority, poor, and low-achieving 
'students show substantial correlations with the posttest score of SAM. ^ * 

u 
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None of the three educational dimensions is found to have cpnsistent and appreciable relationships 
with *\e change of student attitude. Most of the significant findings appear fortuitous and are dif- 
ficult to interpret. Therefore we will not further discuss them. Interested readers may study Tables 
F-15 to F-17 (in Appendix F, one table for each dimension) for details. 

SUMMARY AND CONCLUSIONS 

Five major dimensions of education are examined with respect to the relationships between them 
and the academic development of students. A sequential approach is applied to assess the marginal 
influence of each educational dimension on achievement and the joint influences of the five dimen- 
sions. The five dimensions considered are instructional time, characteristics of instructional person- 
nel, educational environment, teacher practices in the class, and the organization of classes ?or 
instruction. 

The school-year analyses reveal few consistent effects of the educational procession achievement 
growth. On the basis of the.xharacteristics measured in this study, only the experience of teachers 
systematically shows a substantially positive effect: students taught by more experienced teachers, 
tend to achieve greater growth. Other educational variables that also have appreciable relationships 
with achievement progress are primarily the compositional variables that describe the existing con- 
ditions of the school. In particular, high concentration of low-achieving students, which suggests 
that the school may have an unfavorable learning climate and assume a heavy burden of educating 
the deprived children, has an adverse effect on Achievement; this negative effect is consistently 
shown in math. * ^ 

With regard to instructional time, again there is little evidence that the amount of special instruction 
which is mostly provided to compensatory education students has a positive effect on achievement. 
On the other hand, increasing the amount df regular instruction sometimes helps students to 
achieve better. s v v 

The conclusion of the analyses in this chapter is somewhat discouraging. Because the analyses dp 
not support the effects of most of the operational aspects of education, such asjndividualization of 
instruction and principal's leadership, the results are not veryjielpful to the design of effective pro- 
grams. We sDspect that ^unproductiveness of the analyses maybe in part explained by the lack of 
_yajid measures for the important aspects of education. Frequently, variables of conceptual impor- 
• tance are measured distally. For example, individualization is described in terms of the degree of 
differences between teacher treatments of low-achieving ajid regular students. What is more rele- 
vant however, may be the nature of such'differences. 

It may be argued that one problem of the present analysis is that effectiveness of particular educa- 
tional methods can be shown only for specific groups of students because there are likely interac-, 
tion effects between the educational process and student characteristics. To address this problem, 
we will further examine the associations between the effects of education and student 
characteristics in a later chapter (Chapter 8). Meanwhile, We also suggest that more structured 
studies that make in-depth observations of the classes to record more specific details of the interac-. 
tions between teachers and students and the way instruction is actually delivered would prove more 
fruitful in the research for effective programs. In addition, we believe that the effects of education 
may require a longer period than a single school year to become noticeable. 
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, CHAPTER 7. THE CHARACTERISTICS OF EFFECTIVE 

EDUCATIONAL PROCESSES 



In order to determine the characteristics of the educational processes that are effective in 
improving achievement, the findings with multiple-regression analyses in the preceding 
chapter are summarized by grades and by subject areas. It is concluded that few of the 
obviously manipulate characteristics show consistent effectiveness in enhancing achieve- 
ment. Moreover, there are few meanipgful differences among grades with regard to the 
effects of various educational-process variables. The educational dimension that appears 
to be consistently related to achievement growth is one that reflects the existing conditions 
of the school: a school's jpw-achiever concentration is negatively related to achievement 
growth, while school's minority concentration shows positive associations with growth. 
With respect tci other dimensions, only teacher experience systematically exhibits a 
positive (but-not strong) relationship with growth. - V 

Additionally, the technique of discriminant analysis is applied to our data to assist us in 
identifying the educational methods that promote achievement. Two groups of students 
having 'high' and 'low' achievement gains, relative to gains of their peers with comparable 
pretest achievement, are created for the analyses. The roles of the educational variables in 

. the discrimination betwee/f 'high' and 'low' growth students are examinedjn an effort to 
verify their effects on achievement as determined in the earlier regression analyses^. Vie 
agreement between the/findings from the different analytic methods supports the collu- 
sion that, on the basis of our data, few variables are identified as important characteristics 
of the effective processes. Nevertheless, our analyses suggest a general picture that rela- 
tively more effective programs are characterized by more experienced teachers: more 

''regular instruction, more feedback to students regarding their performance, and an envi- 
ronment with faw disturbances of instruction. 

In this chapter we examine in a different way the same issues addressed in the previous chapter, 
with an eye toward shedding light on the contributors to achievement growth that can be 
manipulated by educators and policy makers. Specifically, two groups of students with relatively 
'high' and 'low' achievement growth were created for each grade and each subject, and stepwise 
discriminant analyses were applied in order to identify the educational variables useful for 
discriminating the groups. In these analyses, student background characteristics were disregarded 
because of their uncontrollable nature. This practice is not to be confused with that of ignoring dif- 
ferential effectiveness of educational methods according to student characteristics. The issue of dif- 
ferential effectiveness can be best addressed by subgroup analyses (or analyses of interactions) and 
will be investigated in the 'next chapter^Jhere, the effects of interactions between student 
characteristics and the educational process variables on achievement growth will be examined, and 
similar discriminant analyses that involve only CE students will be implemented to address partially 
the important concern of differential effectiveness. 

Another related comment is that initial ability, which can affect achievement growth, was also not 
taken explicitly as a potential discriminator. However, both initial ability and student characteristics 
have been indirectly considered in the analyses because the formation of the two growth groups 
was made with specific reference to the pretest scores (see a later section for descriptions). To the 
extent the pretest score could serve as a proxy for a composite measure of initial ability and 
background characteristics, the latter variables were in effect taken into account in the analyses.^ 
Aside from the role of the pretest score in the classification of students into th? two analyses groups,* 
an indicator of achievement status corresponding to the pretest quartile score^vas also employed to 
control for possible biases due to regression artifacts in the grouping procedure. 

The discussion of the present chapter will concentrate on the relative effectiveness of the educa- 
tional process variables that can be modified in program designs, and on possible differences in 
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' their effectiveness among grades. Before we begin a series of new analyses, the findings from 
Chapter 6 are reviewed to ascertain any consistent differences Cor simifarities) in the characteristics 
of effective educational processes among grades. 

EFFECTIVE EDUCATIONAL PROCESSES BY GRADES 

Based on the full-model regression analyses using data from the entire samplfc reported in the 
previous chapter (see Tables 6-7 and 6-8), the significant process variables for each grade and sub- 
ject are listed in Table 7-1 along with the sign of their regression coefficients. 

Findings in Reading. Time allocated to regular classroom instruction shows a significant positive 
effect in three of the six grades (1, 2, and 5), suggesting that regular instructional time is important 
for achievement growth in the lower grades. This finding is in agreement with that of other studies 
(e.g., Coles et al., 1976; Guthrie et al., 1976) as noted in the previous chapter. Among the educa- 
tional process variables, only 'Years of Teaching' makes fairly consistent and positive contributions 
to the prediction of reading achievement gain. No other characteristics have significant uniqCie con- 
tributions in more than two grades. School CE concentration is found to have an effect of improving 
reading achievement in the first two grades, likely reflecting the greater effectiveness of reading CE 
in these early grades. Another observation worth noting is that 'Weekly Homework Assigned' has a 
positive and significant effect in grade 1 and again in grade 6. This finding probably implies the 
importance of homework in the beginning year of learning to read and in the upper grades when 
extra-curricular reading helps improve comprehension and unusual vocabulary. Inspection of the 
patterns of the signs of regression coefficients for the remaining variables discloses no systematic 
trends across grades that may l^ad to meaningful interpretations of the differences. On the negative 
side, school's low-achiever concentration is significant in grades 2, 3, and 6. These negative effects 
could be a consequence of the need for greater efforts to raise the achievement levels of lower- 
achieving students, but some schools with high concentrations could still have insufficient resources 
to meet their students' needs, even with CE funds. 

Findings in Math. More time for regular instruction effects greater growth in grades 5 and 6 instead 
of grades 1 and 2 in reading/This reversal from the situation in reading may oe explained by^he fact 
that emphasis on math increases with grades. In the earlier grades, instruction concentrates on 
reading in order to lay a foundation for learning other skills, while in the later grades more instruc- 
tion in math is required to promote learning of the more complex math skills. 

Significant effects of the educational process variables are more numerous in math than in reading. 
On the positive side, the following effects are observed in Table 7-1: 

• 'Years of Teaching' is significant in grades 1 and 2, and then again in grades 5 and 6. The non- 
significant finding in grades 3 and 4 could signify a transition in these two grades before novel 
concept* such as sets and complicated computations such as those involving decimals are 
introduced in higher grades. 

• 'School's Minority Concentration' has significant contributions in grades 2 through 4. The^e. 
results are consistent with the evidence that for CE students, greater gains were achieved by 
minorities than others (see Chapter 4). A plausible explanation would be that minorities tend 
to have fewer opportunities to learn math skills outside the school and benefit more from 
instruction. 

• 'Weekly Homework Assigned' is important in grades 1 and 2 and again in grade 6, a trend 
similar to that observed in reading. This finding suggests that in the earlier grades, some exer- 
cises at home could reinforcglearning in school while by grade 6 extra-curricular practice is 
again needed to master the more complex skills. 

• Frequent provision of feedback on student progress is helpful to learning in jrades 2 and 6. 
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Table 7-1 

Educational Process Variables With Significant Effects on Achievement Growth 
and the Sign of Their Regression Coefficients, for Reading 
and Math by Grade* 



Variables Describing Educational Processes 



Reading in Grade 



Math in Grade 



Instructional Services Received 

< Regular instruction 
Special Instruction 
Tutor/Independent Work 



+ 
+ 



Characteristics of Educational Processes 

Support/Teaching Personnel Ratio 
Years of Teaching 
Highest Degree Earned 

Recent Inservlce Training 

Teacher's Belief in Schooling 
Teacher's Attitude to School Programs 
School's Minority Concentration 

School's Poverty Concentration 

School's CE Concentration 



School's Low-Achiever Concentration 
School's Central Resources 
Parent/Community Involvement 



Principal's Instructional Leadership 
Teacher's Involvement in Decisions 
Disturbance of Instruction 
District's Percent of Administrative Staff 



+ + + +** 

+* * 



+* * 



+ + + 



+** 



Efforts in Planning and Evaluation 
Teacher's Use of Lesson Plans 
Frequency of Feedback Per Semester 
Weekly Homework As signed 
Individualization of Jnstruction 
Monthly Use of Materials 
Monthly Use of Audio-Visual Equipment 
Extent of Ability Grouping 



A summary of the results presented i n Tables 6-7 and 6-8 of Chapter 6* 
"^ysponding variables had non-significant effects, 

EI\£C e contribution to R 2 is less than one-tenth of one percent. 



Blanks in the entrv indicate that the 
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[her significant results included the following: 



• On the negative side, we again find the consistent effects of 'School's Low-Achiever Concen- 
tration' in grades 1 through 5. This observation may be explained in the same way as in 
reading. No other consistent similarities among grades are observed. 

• 'Individualization of Instruction' shows mixed effects: negative in grades 3 and 4 but positive 
in grade 6. There could be an implication that when more complex skills are to be learned as 
in grade 6, instruction according to individual need becomes useful. Differences among 
grades in the effectiveness of the remaining variables do not lend themselves to apparent and 
meaningful interpretations. 

Summary of Findings. Few of the obviously manipulate characteristics of educational process show 
consistent effectiveness in enhancing achievement growth, or have meaningful differential effec- 
tiveness across grades. The noteworthy results are: 

• In both reading and math, 'Years of Teaching* generally exhibits a positive relationship, 
although not strong, with achievement growth. 

• More time in regular instruction is important in effecting greater achievement growth in the 
first two grades for reading, but in the higher grades (5 and 6) for math. 

• 'Weekly Homework Assigned' has positive effects in grades 1 and 6 for both reading and 
math, but not in the middle grades (3 through 5). 

• Two variables, which reflect the existing conditions of the school and are less controllable 
than educational practices, are consistently related to achievement growth: school low- 
Achiever Concentration' contributes negatively to the prediction of reading and math 
achievement in most grades, while 'Minority Concentration' contributes positively to the 
prediction of math achievement in grades 2, 3, and 4. 

In the next section, discriminant analyses are applied to analyze the same data in order to provide 
further insights into the effective educational processes in different grades. 

DISCRIMINANT ANALYSES FOR IDENTIFYING EFFECTIVE 
EDUCATIONAL PROCESSES 

Additional analyses using the techniques of stepwise discriminant analysis were performed at each 
l> grade for reading and math to describe the discriminating power c\ the variables for services and 
educational processes in distinguishing between students of greater growth and less growth. 

For reading and for math separately, time spent in the three instructional settings and characteristics 
of educational processes that were selected in earlier hierarchical stepwise-regression analyses (see 
Chapter 6) in at least one grade are pooled to serve as potential discriminating variables for the pre- 
sent analyses. These variables were listed in the first column of Tables 6-7 and 6-8 for reading and 
math respectively (minus the pretest and student characteristics). As mentioned earlier in this 
chapter, the pretest quartile score was also employed as a control variable for adjusting possible 
biases due to regression artifacts. In addition, selection for CE services was used to reflect specifi- 
cally the effects of CE that may not have been associated with the discriminating variables. This 
residual effect of CE may incL.de influences of student characteristics as well as other unmeasured 
educational dimensions. Two additional variables, one for reading and one for math, were 
developed to designate the group membership.Chigh' and 'low' growth) for each student in terms of 
his/her achievement growth in the respective skill during the school year. 
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Parallel analyses were performed for reading and math employing corresponding analysis groups 
and discriminating variables. These discriminant analyses were motivated by a concern that effec- 
tive educational methods were often determined on the basis of results from regression analyses. 
Whether these methods indeed efficiently differentiate successful programs from unsuccessful ones 
at the program level, or more important, whether differential exposures to the component pro- 
cesses of these methods in fact discriminate between students of larger and smaller gains haye rarely 
been verified. 

We therefore decided to strengthen the findings of the earlier regression analyses with validations of 
the discriminating power of the effective educational variables. 

Student Grouping in Terms of Achievement Growth 

Ideally, the posterior predictive distribution function (Box and Tiao, 1973; Zellner, 1971) for the 
posttest scores given the student background characteristics and pretest scores should be emplc/ed 
to determine if student growth is higher or lower than expected on the basis of the data we have 
accumulated. Unfortunately, such predictive distribution functions differ (in parameters) for each 
distinct combination of values for the background variables and pretest scores. The calculations of 
the probability that the predicted posttest score exceeds the obtained score for each studen£ would 
be very costly. Therefore, we opted for some less sound procedures to identify the students with 
noticeably larger and smaller growth than expected. Specifically, we created two separate indi- 
cators employing each student's 'z-score' gain and simple VSS gain (see Chapter 2). 

Growth Indicator Based on Standardized -Score Cain, For the first indicator of growth (reading and 
math separately), the student is assigned to the 'high' group if his/her 'z-score' gain exceeds zero by 
at least one standard deviation of the 'z-score' gain in the population, and is assigned to the 'low' 
group if it falls below zero by at least one standard deviation. Those students with 'z-score' gains fall- 
ing between the one standard -deviation range are assigned to the 'average' group. The standard 
deviation of 'z-score' gain in the population is estimated by V2(1-r), where r is the average test- 
retest correlation between the fall and spring VSSs as reported in Table 1-15 of Report 9. The 
estimated standard deviations for z-score gains to, be used in the creation of this growth indicator are 
presented in Table G-1 of Appendix G. This rule is selected because one expects a student to main- 
tain his/her relative achievement status under normal circumstances. This method of calculating the 
group-membership indicator, then, is especially sensitive to students who have grown unexpectedly 
much or little, relative to the population to which they belong. 

Growth Indicator Based on Vertical-Scale-Score Cain. For the simple VSS gain, the indicator was 
determined based on the projected average growth for a group of students who have similar pretest 
achievement status. The pretest percentile ranks were blocked into ten categories (deciles). Then, if 
a student's VSS gain from fall to spnng exceeds the projected mean VSS gain by at least one standard 
deviation for his/her group (decile), the student is assigned to the 'high' growth category. If the stu- 
dent's VSS gain falls below the projected mean for his/her group by at least one standard deviation, 
the student is assigned to the 'low' growth category. A VSS gain falling between the one standard- 
deviation ran^e of the projected mean for the appropriate decile group is assigned to the 'average' 
category. The reason that the pretest percentile ranks were blocked by the deciles for the deter- 
mination of student growth status is in part due to the considerations of differential expected growth 
for students at different achievement levels, and the possible ceiling and floor effects of the tests 
administered, particularly for the groups of students having extreme scores. The projected means^ 
and standard deviations for the construction of this second growth indicator were presented in 
Table B1-1 of Appendix B1. 

Definition of Student Croups. The two indicators are combined in order to form the analysis groups: 

• 'High-Growth Students'. Students are 'high' on both of the component indicators based on 
z-score gain and VSS gain. 



ERjC - 203 237 



• 'Low-Growth Students/ Students who are low' on both of the component indicators. 



• 'Average-Crowth Students. ' All the remaining students who are not classified into the 'High- 
Growth' or 'Low-Growth' groups. 

Achievement Growth and CE Status. Once each student could be classified into a 'high', 'average', 
or 'low' growth category in a fairly reliable manner (the reason we employed two different 
approaches), it seemed promising to tabulate the students by their categories of growth and their 
CE-status to see if any groups at any grades had relatively more of some type of student than other 
groups did. Summary data of the cross-tabulations are presented in Table 7-2 (Table G-2 in Appen- 
dix G provides more complete information from which Table 7-2 has been extracted). 

The entries in Table 7-2 may be interpreted as 'success rates' on the basis that high values represent 
the movement of students into the 'high-growth' category and out of the 'low-growth' category. If it 
is also assumed that in the population the ratios, by chance, approximate 1.00 (based on the notions 
of a symmetrical distribution of achievement scores from which the growth categories were 
calculated), then additional meaning may be added to these data. In this respect, it should be 
remarked that inspection of the last column of Table G-2 reveals some tendency for larger propor- 
tions of 'low' growth than 'high' growth students. This could in part be explained by the inclusion of 
purposively selected samples, especially the comparison schools, such that 'low' growth students 
are disproportionally represented in the total sample. 

Adopting this frame of reference, we found no consistent pattern for the ratios over the grades or 
# among the six CE groups in reading. The only noticeable consistency is that for CE students within 
Title I schools; Title I students tend to have higher ratios than do non-Title I students, with an excep- 
tion in grade 6. The picture for math is quite different. In five of the six grades (except for grade 2), 
Title I students achieve the highest ratios among the three groups of CE students. In fact, for grades 3 
through 6, Title I students also show higher success rates than any of the three groups of non-CE 
students. Other-CE students, however, attain lower success rates than non-CE students with few 
exceptions. In both reading and math, erratic patterns of ratios over grades emerge for Other-CE 
■ students, possibly a reflection of the wide variations of types of students and programs that comprise 
these other-CE categories. These summary findings support earlier results that CE, specifically Title I, 
is more effective in math than in reading. 

The Stepwise Discriminant Analysis 

Using the 'high' and 'low' growth groups in each grade and for each subject, a stepwise discrimi- 
nant analysis was performed to select efficient discriminators. The potential discriminatory 
variables, as explained in the beginning of this section, are listed in Tables G-3 and G-4of Appen- 
dix G for reading and math, respectively. The readers are reminded of the addition of the pretest 
quartiles and CE status to the set of educational variables in order to control for possible selection 
biases in the analysis groups. The purpose was to see if these two variables have any discriminating 
power. Their roles in the distinction between the two groups could affect the interpretation of the 
results. For instance, if pretest achievement plays an important role in the discrimination, it may sug- 
gest that the definition of the analysis groups ('high' and 'low' growth) is largely correlated with 
pretest score (even though we attempted to reduce such a correlation by blocking) and, thus, inter- 
pretations should be made with special caution. 

The sane set of potential discriminators was used for all grades, but the analyses were performed 
separately for each grade. Consequently, different sets of discriminators may be selected for dif- 
ferent grades. Our aim is tp compare the set of useful discriminators obtained across the grades. The 
results provide us with additional information on the characteristics of effective educational ser- 
vices, and their differences among grades. 

The summary statistics obtained in the stepwise discriminant analyses, helpful for a thorough 
understanding of the tinal results, are presented in Tables G-3 and G-4 of Appendix G for reading 
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and ma'<h, respectively. These twb tables present the means of each potential discriminator for each 
group ('high' and low' growth groups), along with indicators of whether the means for the two 
groups are significantly different. We present the means because they provide some references for 
interpretations of the discriminant functions. 



Table 7-2 

Ratios of Number of Students of 'High' Growth to Number of Students of 'Low' Growth 
in Reading and Math by CE Category and Grade 
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Reading 
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.57 


.54 
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1.11 
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1.03 


* 2 
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.58 


1.29 


.82 


.97 


.64 


3 


.94 


.69 


1.10 


1.05 


1.19 


1.02 


4 
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1.04 
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1.08 
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Math 
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1.12 


.72 


1.11 


1.16 


.85 


.71 


2 


.69 


.60 


.85 


.94 


1.10 


.73 
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.98 


.52 


.37 


.84 


.88 


.91 


4 


1.21 


.70 


.39 


.88 


.94 


1.00 


5 


1.29 


.57 


.97 


.89 


1.18 


l.?<* 


6 


1.08 


.82 


.52 


.78 


.71 


.69 



Croup Differences With Respect to the Educational Variables. The data in Table G-3 for reading are 
summarized below. Pretest achievement status is significantly different between the two groups in 
all grades. CE participation rates also differ significantly between the groups in grades 1, 4, and 5. 
Where differences exist, the 'low' growth group tends to have higher initial achievement and higher 
proportion of CE students. Even with our definitions of the growth groups, where assignment of 
group membership was conditioned on pretest status, differences in initial achievement still are 
important. Apparently, the distributions of the gain scores are skewed in some groups of students, 
especially those who score at the top and bottom quartiles in the pretest. The skewness of the 
distribution may be explained by regression artifacts, ceiling and floor effects, and the fact that there 
are few difficult items left for the high pretest scorers and many easy items for the low pretest scorers 
to answer correctly to obtain higher posttest scores. Consequently, the chance errors may cause 
proportionally more students with higher pretest scores to fall into the low' group, and more with 
lower pretest scores to fall into the 'high' group. Such misassignment of group membership is par- 
ticularly pi obable for those who score at the 99th and the 1st percentiles in the pretest. The former 
cannot be assigned to the 'high' growth group because the upper bound for their z-score gains is 
zero, while the latter cannot be assigned to the low' growth group because of a lower bound of 
zero for their z-score gains. 
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The joint observation of lower initial achievement quartiles and higher proportion of CE students for 
the low' growth group suggests a hypothesis that some students in the low' growth group may 
have attained unusually high pretest scores by chance but still are recognized as having need for 
compensatory assistance and receive CE services. As a result of the measurement error in the 
pretest, they tend to exhibit lower gains than others in the same achievement group. On the other 
hand, some students in the 'high' growth group may have scored low by chance but actually have 
higher ability and do not receive CE services. This type of measurement error in turn results in 
higher apparent gains in comparison with those made by others of similar pretest scores. As re- 
marked in Chapter 2, whenever pretest scores are employed directly as the basis for grouping, there 
will be some regression artifacts. These summary findings point to a situation where a greater 
number of CE students with high pretest scores are assigned to the 'low' growth group. In anticipa- 
tion of such confounding factors for the discriminant analysis, the pretest quartile scores and the in- 
dicator for CE status have been used in the analyses so that they may be selected 
into the discriminant function to adjust for the effects of these factors. 

In cases where. differences exist, the group with 'high' reading growth tends to receive more regular 
instruction, but less in special instruction, and spends more time in independent work. This group 
also tends to have teachers with more years of teaching experience. The results across grades are 
generally inconsistent for the other variables, however. 

Table G-4 presents the means for the two groups for math. Once again, the 'high' growth group 
tends to have lower initial achievement, but there js little difference in proportion of CE students. 
Again, the agression artifacts due to measurement errors as well as the floor effects of tests offer 
some plausible explanations for the lower initial achievement quartiles of the 'high' growth group. 

Where there are differences, the 'high' growth group receives more regular instruction. There are 
also significant differences in amount of independent work in grades 1 and 2, but the direction of 
the differences is* not the same in the two grades. In grades 2, 3, and 5, 'high' growth groups have 
teachers with more years of teaching experience. In addition, students having 'high' growth on the 
average receive more feedback from their teacher^ in all grades. The degree of individualization of 
instruction, while showing significance, demonstrates inconsistent directions of difference between 
the two groups. 

With respect to school conditions, the 'high' growth students tend to be in schools having lower 
minority concentrations, lower poverty concentrations (grades 2, 3, and 5), and lower concentra- 
tions of low achievers (grades 3 and 5). The schools attended by 'high' growth students also tend to 
have lower CE concentration (grade 3 through 5, but an opposite result is found in grade 1). Finally, 
there are fewer instructional disturbances in the schools where the 'high' growth students come 
from. The differences of means of the remaining variables are either inconsistent or tend to be 
insignificant. 

Results of the Discriminant Analysis for Reading. The results of the stepwise discriminant analyses are 
provided for reading in Table 7-3- in this table all the potential discriminators are listed, along with 
their standardized coefficients for th * final discriminant functions. In the iower part of the table we 
present summary statistics for the selected discriminant function. They include the mean discrimi- 
nant scores for the two groups, statistical tests ot the discriminating power of the function, canonical 
correlation, and correct classification rates using the function. The latter two statistics are also pro- 
vided for the complete discriminant function, using all potential discriminatory variables (28 for 
reading) so that the efficiency of the selected discriminant function with a reduced number of 
variables can be assessed. 

The data in Table 7-3 reveal that the results of reading vary considerably over grades. Only the 
pretest achievement and CE status play a role in the discriminant functions for all six grades. After 
adjustment for differences in these two variables, special instruction is still negatively related to fr? 
growth' category in four of the six grades ('lower' growth students tend to receivp more special 
instruction)- Instructional services play a stronger role in discriminating the growth groups at the 
lower grades than at the higher grades. 
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Table 7-3 



Stepwise Two-Group ('High' vs 'Low' Fall-to-Spring Growth) Discriminant Analyses for 

Examining the Effects of Instructional Services Received, and Characteristics of 
Educational Process on Student Reading Achievement Growth* 

Standardized Discriminant Function Coefficients (Beta) 
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1 



Two groups of studer*s with comparatively 'High* and 'Low' growth from Fall-to-Spring were formed for the discriminant analysis for each 
grade, The groups comprise students having reading achievement growth one s.d. above and below* respectively* the average growth of 
their peers with comparable fall achievement. Please refer to the text for a detailed account of the grouping procedure. The potential 
«»tors employed include pretest achievement status* CE status* three kinds of instructional services received, and 23 educational 
v riablos that were found in the earlie. analyses to be effective in predicting posttest scores for at least one* of the six grades 
<C D 1/^5-7). The selection criteria of the discriminators In the stepwise procedure are 4.0 for "F-to-Enter' and 3.9 for 'F-to-Remove' . 

V . , ,. ^r , n . reedc 



reedom ■ number of discriminators selected) all chi-squares are significant at th*» .01 level. 
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With regard to instructional personnel, 'Years of Teaching' serves as a useful discriminator in five of 
the six grades (except for grade 5), indicating that more experienced teachers may promote 
achievement. Additional noteworthy results are that high CE concentration and low concentration 
of low achievers in the school are systematically associated with 'high' growth in all grades except 
grade 4. The exception in grade 4 is another reflection of the general results that few variables con- 
tribute to explanation of reading achievement growth in this grade. 'Frequency of Feed' ick per 
Semester' tends to be related to 'high' growth in grades 4<anrJ 5, but has a weak associat.on with 
'low' growth in grade 1 . Discriminating powers for the remaining variables either fail to exhibit con- 
sistent patterns or do not suggest meaningful differences, among grades. On the whole, the results of 
these discriminant analyses tend to reinforce the findings of the previous chapter (Chapter 6). 

It may be seen in the bottom section of Table 7-3 that, although all the discrirninantfunctions are 
highly significant, the canonical correlations and the percents of correct classification made by the 
discriminant functions decrease with increasing grades. The rates of correct classification, further- 
more, are not very high. Inclusion of all the potential discriminators into the function does not 
improve the discriminating power appreciably. It can therefore be concluded that the reduced set 
.of discriminating variables is satisfactory for the present purpose. 

To summarize the results ofthe discriminant analysis fcr reading, we list below the first three 
• educational-process variableslhat effectively distinguish between the two growth groups. A positive 
association with the 'high'.growth group is indicated by a in parentheses, while a negative 
association is indicated by a '-'. 

Grade 1: Regular Instructional Services Received (+) 
Monthly Use of Materials (+) 
^School's CE Concentration (+) 

Grade 2: School's Minority Concentration (-) 

Special Instructional Services Received (-) 
Teacher's Years of Teaching (+ ) 

Grade 3: Special Instructional Services Received (-) 
School's Low-Achiever Concentration (-) 
Tutor/Independent Work (+) 

Grade 4: Special Instructional Services Received (-) 
Disturbance of Instruction (-) 
Teacher's Years of Teaching (+) 

Grade 5: School's Low-Achiever Concentration (-) 
Regular Instructional Services Received (+) 
Staff/Student Ratio (-) 

Grade 6: Teacher's Years of Teaching (+ ) 

Teacher's Recent Inservice Training (+) 
Teacher's Highest Earned Degree (-) 

In comparison with the results based on regression analyses, the present results tend to accentuate 
the negative effects of special instruction on growth. As explained earlier, this finding is very likely a 
consequence of the practice of allocating services according to need. The finding for 'Years of 
Teaching' is in agreement with that from the regression analysis. 

In passing, a few remarks may be of fnterest. The failure to find a uniform set of characteristics of 
effective education processes for all grades is evident, in addition, few meaningful interpretations 
are obvious for the wide variations of effective educational processes over grades. A similar situation 
occurred in the Compensatory Reading Study (Trismen, Waller and Wilder, 1976) where com- 
parisons between effective and ineffective schools were unable to obtain interpretable differences 
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or consistent similarities among grades regarding characteristics of effective educational methods. 
The fact that some educational variables, such as staff/student ratio (more teacher^), individualiza- 
tion of instruction, .and principal's instructional leadership (quality of administration), were seldom 
found to be effective is somewhat incongruous with the evidence reported in previous studies (see a 
summary in Jable 18 of McLaughlin, 1977). 

Results of the Discriminant Analyses for Math. The result* 'or the math analyses, reported in 
Table 7-4, are a bit more consistent than those for reading (as was also true for the regression 
analyses of the previous chapter). After adjustment for pretest achievement and/or CE status, receipt 
of regular instruction makes consistent and positive contributions to the differentiation between the 
groups. The effects of time in regular instruction were made more apparent in these analyse^than in 
the regression analyses. Work with tutor or independently makes similar contributions at all but the 
second grade. Receipt of special instruction plays a small and inconsistent role, largely because of its 
association with lower pretest scores. More years of teaching experience is associated with 'high' 
growth in grades 2, 4, 5, and 6. 

High concentration of low achievers in the school differentiates between the growth groups in the 
first five grades in the direction that high concentration is related to low growth'. CE concentration 
in the schools is a favorable condition for growth in the first two grades. As in reading, frequent 
feedback to students is helpful to achievement in grades 4 through 6. More homework assigned is 
related to 'high' growth in grades 1,2, and 6. Favorable teacher attitude to school programs tends to 
contribute to 'high' growth in four of the six grades (except in the two middle grades, 3 and 4). in 
grades 4 through 6, disturbance of instruction is associated with 'low' growth, but a reversed rela- 
tion is found in grade 2. The overall results indicate a greater number of variables selected as useful 
discriminators than that found significant in the regression analyses. 

The remaining variables show inconsistent results across grades or do not contribute significantly to 
discrimination between the groups in more than one grade. 

Vhe canonical correlations and percentages of correct classification decrease slightly in the upper 
two grades, but they are generally larger than those for the reading analyses in grades 3 through 6. 
The stepwise procedure again effectively selected the useful discriminators, as there was little reduc- 
tion in the canonical correlation and rate of correct classification in all grades as a result of dis- 
carding some of the 30 potential discriminators. 

In summary, the first three contributors to the distinction between the growth groups in math (as 
determined by the stepwise procedure), excluding pretest and CE status, are listed below by grades. 
Tfie directions of the relationships are indicated by '+ ' or '- ' in the same way explained earlier for 
the reading analyses. ^ 

Grade 1: School's Lofo-Achiever Concentration (-) 
Tutor/Independent Work (+) 
School's CE Concentration (+) 



Grade 2: 



School's Low-Achiever Concentration (-) 
Teacher's Years of Teaching (+) 
School's CE Concentration (+) 



Grade 3: 



School's Low-Achiever Concentration (-) 
Principal's Instructional Leadership (-) 
Regular Instructional Services Received (+) 



Grade 4: 



Disturbance of Instruction (-) 

School's Low-Achiever Concentration (-) 

Individualization of Instruction (-) 



Table 7-4 



Stepwise Two-Group ('High' vs. 'Low' Fall-to-Spring Growth) Discriminant Analyses f&*> 
Examining theLEffects of Instructional Services Received, and Characteristics of -J 
Educational Process on Student Math Achievement Growth? 



^ Standardized Discriminant Function Coefficients (Beta) 



Discriminating Variables 


Grade 1 


Grade 2 


Grade 3 


Grade 4 


Grade S 


Grade 6 


Selected by the Ste*pwise 


















































Discriminant Procedure 


Entry 
Order 


& ta 


Entry 
Order 


Bate 


Entry 
Order 


Beta 


Entry 
Order 


Beta 


Entry 
Order 


Beta 


Entry 
Order 


Beta 


Student Characteristics 


























Pretest Achievement Quart ile 


1 


-.90 


1 


-.97 


1 


-.94 


1 


-."92 


1 


-.77 


1 


-.86 


Participation in Compensatory education 


5 


30 


4 


-.40 


6 


-.13 


10 


-.14 


HA 




HA 




Instructional Services Received 
Regular Instruction 


























10 


.08 


11 


.09 


4 


.IS 


15 


.08 


4 


.29 


10 


.19 


Special Instruction 


KA 




8 


-.10 


KA 




9 


.20 


KA 




KA 




Tutor/Independent Work n 


3 


.21 


KA 




s 


.08 


14* 


.13 


5 


.23 


11 


.17 


Characteristics of Educational Process 


























Support /Tea chin 9 Per&onrfel Patio 


11 


-.08 


KA 




UK 




KA 




HA 




7 


-.24 


Years of Teaching 


KA 




3 


. 22 


KA 




16 


.09 


6 


.19 


13 


.14 


Recent Xnservice Training 


16 


.06 


KA 




KA 




KA 




HA 




MS 




.Belief in Schooling 


7 


.17 


KA 




KA 




KA 




KA 




9 


-.12 


Attitude to School Programs 


8 


.16 


6 


.12 


KA 




KA 




9 


.13 


S 


21 


School's Minority Concentration 


N A 




10 


-.16 


KA 




12 


.!« 


KA 




12 


-Trr 


School's Poverty Concentration 


KA 




KA 




7 


.19 


KA, 




HA 




KA 




School's CE Concentration 


4 


.41 


5 


.31 


KA 




KA 




KA 




KA 




School's Low-Achiever Concentration 


2 


- . 38 


2 


- . 33 


2 


- .65 


3 


".34 


2 


- .50 


KA 




School's Central Resources 


12 


12 


KA 




KA 




KA 




KA 




KA 




Parent/Community Involvement 


HA 




KA 




KA 




13 


-.11 


7 


.16 


KA 




Principal's Instructional Leadership 


KA 




KA 




3 


-.16 


HA 




HA 




KA 




Teacher's Involvement in Decisions 
Disturbance of Instruction 


6 " 


- .22 


KA 




KA 




S 


- .14 


KA 




KA 




KA 




9 


.11 


KA 




2 


- .20 




- 28 


2 


- .27 


District's Percent of Administrative staff 


13 


.09 


KA 




KA 




7 


- 14 


11 


-12 


HA 




Effort m Curriculum Development 


KA 




NA 




.A 




6 


.15 


HA 




KA 




Teacher's Use of Lesion Plans 


tlh 




KA 




KA 




HA 




10 


.12 


14 . 


.10 


Frequency of Feedback per Semester 


KA 




KA 




HA 




8 


.14 


3 


.10 


3 


.23 


Weekly {foJtework Assigned 


9 


.10 


7 


14 


KA 




NA 




HA 




4 


.27 


Monthly Use of Materials* 


NA 




KA 




KA 




11 


*: ii 


HA 




KA 




Individualization of Instruction 


14 


.10 


KA 




KA 




4 


-.20 


KA 




8 


.17 


Monthly Use of Audio* Visual Equipaeit 


IS 


-.10 


KA 




KA 




HA 




HA 




HA 




Class Size 


KA 




KA 




KA 




KA 




12 


.11 


6 


.18 


Statistics for the Discrimnant Function 


























Mean Discriminant Scores 


K 




K 


Mean 


K 




K 


M <ein 


H 


Mean 


K 


Mean 


'HicV Growth Croup 


1.639 


.419 


1.326 


.441 


1.192 


.530 


1.301 


.450 


1,347 


.379 


1.570 


.373 


•Low' Growth Croup 


1,572 


-.437 


1.432 


-.409 


1,385 


-.456 


1.423 


-.411 


1.337 


-.382 


2.003 


-.292 


Wilk's Lambda 


.817 


.819 


.759 


.1 


315 


.855 


.891 


Chi-Square Test Statistics** 


647.9 


54G 


.4 


709 


.5 


5S4.6 


416 


.5 


411 


.7 


Canonical Correlation (Squared) 


.426 


(.18)) 


.425 


(.161) 


.491 


(.241) 


.430 


(.165) 


.381 


(.145) 


.3)0 


(.109) 


. Percent of Correct Classification 


69 


.1 


68 


0 


71 


• 1 


68.9 


65 


2 


64 


.4 



When all 30 Potential Discriminators are used 

> » * 

Canonical Correlation (Squared) .432 (. 167) .434 ( . L88) .499 (.249) .436 (.190) .389 (.ISl) .337 (.114) 

Percent of Correct Classification 69.3 69.1 70.8 68.7 67.2 64.4 

a 

*Two groups of students with comparatively 'High-* and 'Low' growth from Fali-to-Spring were formed for the discriminant analysis for each 
grade. The groups coaprise students having math achievement growth on* s.d. above and below, respectively, the average growth of their 
Q cumparable fall achievement. Please refer to the text for a detailed account of the grouping procedure. The potential 
pv | ^> ;ors employed include pre*#fct achievement status. CE status, three Kinds of instructional services received, and 25 educational 
p w\ \ ( 'tables that were found in the earlier analyses to be effective in predicting posttest scores for at least one of the «ix grades 
^.m.J!m^»^ 6-8). The selection criteria of the discriminators in the stepwise procedure are 4.0 for 'F-to-Enter* and 3.9 for 'F-to-Reaove* . 
"Degree of freedom - number of discriminators selected j all chi-*qu*res axe significant at the .01 level. , [ 



Grade 5: School's Low-Achiever Concentration (-) 

Disturbance of Instruction (-) , 
Regular Instructional Services Received (+) 

Grade 6: Disturbanle of Instruction (-) 

Frequency of Feedback Per Semester (+) 
Weekly Homework Assignee! (+) 

As evidenced from this list, the school's Low-Achiever Concentration was selected first in four of the 
$ix grades, and second in one grade (the entry order Is determined excluding that for pretest and CE 
status). Characteristics of educational environment are ; found to be frequent contributors to dif- 
ferentiation between the 'high' and 'low' growth groups. ~ 

Conclusions From the Stepwise Discriminant Analyses* In general, there are more educational 
variables found to be significant and consistent discriminators for math growth than for reading 
growth; the same findings held in the multiple regression analyses of Chapter^. Although the two 
variations of analysis in terms of linear models are expected to yield similar results, we.have 
designed the two approaches so that they can provide complementary information. 

The lists of discriminating variables for both reading and math do not provide us with information 
that can be incorporated into some meaningful model of education that might change systemati- 
cally over the grades. Nor does it provide us with much ^information useful to guide decisions about 
what services and practices are most promising, if there are any. 

Further Analyses in Order to Obtain Consistent Findings Over Grades 

As an adjunct to the stepwise discriminant analyses, we calculated additional functions from a 
further-reduced set of variables, in an effort to obtain some consistent and meaningful information 
that could prove helpful. First, we eliminated from consideration any variable from Tables 7-3 and 
7-4 that had only one significant coefficient (per table). Second, we eliminated any variable that had 
only two* but differently signed, coefficients in adjacent grades. Last, we eliminated all variables that 
are not directly controllable by educators, i.e, the compositional variables. (This condition may be 
somewhat ambiguous; for example, we conr-«der that a school's concentration of CE is not con- 
trollable, although technically many CE prog/ams could be thoughtlessly spread to all students in 
the school. We believe that such a thoughtless policy, however, is not one we'd want to consider as 
a potential recommendation from our discriminant analyses. Such a recomrtf^idation would most 
likely represent an insensitive misinterpretation of the findings.) These variables describe peer- 
group characteristics in a school and are most appropjiately viewed as situations that can' be 
adverse or beneficial to achievement growth. Their effects on educational development of students 
would most likely be explainable through their influence on other operational characteristics of the 
school's programs and their direct rela:ion to their student characteristics. 

Basically, we depart from the explorative, fact-finding approach of the preceding sections, and con- 
centrate on obtaining a comprehensive set of findings, even if they make marginal contributions. 
We trust that 'every little bit of help counts'", and that our adjunct analyses will provide consistent 
and meaningful 'little bits' of help. There were 15 variables selected for these additional discrimi- 
nant analyses for both reading and math, although they were not the same set of variables. Three 
sequential reductions for the reading variables and fpur for the math led to the final lists of variables 
that made fairly consistent and meaningful contributions to the differentiation between the 'high' 
and 'low' growth groups. The variables that remained, their standardized coefficients for the 
discriminant functions, and summary statistics for the functions are presented in Table 7-5. 

The trade-off for obtaining the fairly consistent and meaningful discriminant functions is a substan- 
tial loss of discriminating pov^er, as indicated by the reductions inxanonical correlation and percent 
of correct classification. Comparing the data in fable 7-5 with those in Tables 7-3 and 7-4, we find 
that the reduction from 28 and 30 discriminating variables to seven and six for reading and math, 



Table 7-5 . 

Discriminant Functions for Reading and Math That Differentiate Between 'High' 
and 'Low' Growth Students, Based on a Small Set of Manipulate Variables 



Standardized Coefficients* 



Discriminating variables 





fir 1 


fir 9 


fir "X 


fly A 


or • o 


fir A 
ui • o 




Reading 












Regular Instruction 




(.22) 


(.09) 


♦ .49 


.69 


.43 


Tutor/tndependent Work 


.46 


(.06) 


.44 


* .44 


* (.15) 


.41" 


Years of Teaching 


.49 


.76 


.Sri 


.46 


.31 


-.49 


Disturbance of Instruction 


+ • JO 


-.26 


I • * * ) 


-.40 




-.35 


Effort in Planning and Evaluation 


(.06) 


.26 


.57 


* (..18) 


(.14) 


.35 


Teacher's Use of Lesson Plans. 


£,10) 


-.29 


(.03) 


(.'22) 


(.19) 


.30 


Frequency of Feedback per Semester 


. (.03) 


.25 


(.22) 


.48 


(.12) 


•(.26) 


Percent of Correct Classification 


57.5 


57.2 


54.5 


54.1 


56.1 


54 .8 


Canonical Correlation 


.21 


.17 


.12 


.11 


.15 


.12 


Mean of 'Low 1 Group 


-.19 


-.15 


-'.12 


-.*10 


-.14 


-.11 


Mean of •High 1 Group 


.22 


.19 - 


.12 


.12 


.16 


.12 


Percent of Correct Classification 


* - 
62.3 


- 

57.5 


54.0 


55.0 


55.5 


57.7 


With All 15 Selected Variables 








« 


Wth 












Regular Instruction 


\,0 


* .35 


.48 


(.20) 


.47 


.14 


Tutor/Independent Work 


.75 


-.23 


. .40 


(.03) 


.31 


<35 


zears or xeacnxn^ 


• Z\) 






\ #u / 1 




\. it) 


Attitude to School Programs 


.40 


.34 


(-.18) 


,•(.2/) 


" .34 


.35 


SUstujroance of Instruction 


(-.04) 


(.01) 




Qn 
— . oU 


— .t>l 


— . DO 


Frequency of Feedback per Semester 


.35 


.28 


.43* 


*.47 


.21 


.60 


Percent of Correct Classification 


56.5 


57.4 


57.6 


56.4 


57.5 


56.0 


Canonical Correlatiori 


.13 


.17 


.15 


.13 


.22 


.13 


Mean of 'Low 1 Group 


-.12 


-.16 


-.14 


-.12 


-.22 


-.12 


Mean of 'High 1 Group 


'.13 


.18 


.16 


.13 


.22 


.15 


Percent of Correct Classification 


58.7 


58.0 


57.2 


58.4 


59.4 


57.8 


With All 15 Selected/Variables 








/ 







*The coefficients are enclosed in parentheses for the variable^ that would not 
^be selected if criteria of 4.0 for 'F-to-Enter* and 3.9 for 'F-to-Remove • 
were used. 



respectively, results in considerable decreases in percent of correct classification. These decreases 
generally range from 8 to 13 percent except in reading at the upper grades. For reading, the 
decreases are approximately 3 to 5 percent in grades 4, to 6. This finding is largely explainable by the 
observations that the pretest quartile, CE status, and the compositional variables (i.e., concentra- 
tions) are the discriminators to enter early into the previous discriminant functions. These variables 
generally have greater discriminating power and when eliminated are likely to cause reductions in 
the overall efficiency of the discriminant functions. 

For the reading analyses, the compositional variables, however, did not enter early into the function 
in the upper three grades. 
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Table 7-5 also provides the percentages of students correctly classified when all the 15 variables 
selected for the analyses are used to obtain the discriminant functions. Comparison of th«se percen- 
tages with those obtained in the final analyses that use a smaller set of variables (seven in reading 
and six in math) shows very Httle reduction in the classification ability of the discriminant functions. 
It should be noted, however^ that the functions have little discriminating power, as evidenced by 
the low canonical correlations and the small (albeit significant) improvement over correct classifica- 
tion by chance alone. 

Five of the contributing variables are commoji to both readingand math (but they were not s lected 
on that basis). In general, we can see that the amount of regular instruction, the amount of work 
with a tutor or independently, the teacher's years of teaching experience, and the frequency of 
feedback per semester are all associated with 'high' growth. Disturbance of instruction is generally 
adversely related to achievement growth, but the relationship is not very strong in the lower grades. 
More important, it does not show the same negative relationship with growth in both reading and 
math for grade 1. This deviant case was also noted in Summers and Wolfe (1977). Perhaps at this 
early stage of schooling, children are not aware of the disruption and therefore are not affected by 
it. 

In reading, teacher's use of lesson plans still does not exhibit consistent and substantial contribu- 
tions to discriminating power, though there is slight evidence that in the upper grades it is related to 
'high' growth (possibly because at the higher grades more content is being taught, and it needs * 
organization to be effectively presented to the students). Teacher efforts in planning and evaluation 
are positively related to 'high' growth, but not strongly at most grades. In math, teacher attitude 
toward the school's program is positively related to 'high' growth in all grades but grade 3. 

SUMMARY AND CONCLUSIONS 

Although the results of these adjunct analyses are not particularly encouraging, they suggest a 
general picture of more effective educational processes that are characterized by: 

• Teachers with more years of teaching experience 

• Receipt of more regular instruction 

• More time in work with tutor or independently 

• More frequent feedback to students (especially in math) 

# 

• An environment with few disturbances of instruction 

A review of the results in Tables 7-3 and 7-4 shows support for this same conclusion. We feel that 
this picture is closer to the idea of 'traditional' American education than it is to the current concep- 
tions of compensatory education (that frequently stress innovation and special instruction). The 
good intentions of CE programs in specifying services that will be especially effective were not 
validated in the present analyses. 
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CHAPTER 8. THE EFFECTS OF EDUCATIONAL PROCESSES 
AND STUDENT CHARACTERISTICS 



l&order to help educators design programs that best serve their students and to further 
our understanding of the achievement process, we investigate how the effects of educa- 
tion differ for different kinds of students. For this purpose, we employ multiple-regression 
models to examine the effects on achievement of the interactions^oetween educational 
dimensions and student characteristics. No clear picture emerges from the analysis con- 
cerning what educational methods are most effective for what kinds of students. 

In reading, the few significant interactions seem to support the conclusion that educa- 
tional aspects emphasized by CE programs tend to be more beneficial to the achievement 
of students who are more likely to receive CE. While this abstracted finding is encouraging, 
the reader is warned that we have little confidence of its practical meaning considering 
that each result is obtained only in an isolated grade. In math, most of the interactions in- 
volve the schools' existing conditions that are determining factors of receiving CE funds; 
the few other interactions that involve manipulable characteristics of the educational pro- 
cess are weak and not shown in more than one grade. Thus, our analysis does not provide 
much insight into the differential effects of the educational process on the achievement of 
different groups of siuden ts. 

Because we are particularly concerned about the design of effective CE programs, we fur- 
ther employ the technique of discriminant analysis to help us identify the educational fac- 
tors that account for the differences between CE students having high and low achieve- 
ment gains. The analysis fails to find any educational methods that are particularly 
beneficial to achievement for CE students, while not for all elementary students. Among 
the variables that can be reasonably manipulated, only teacher experience and amount of 
work with tutor or independently are consistently related to achievement growth of CE 
students (and also of other students): more experienced teachers and more independent 
work are helpful. 

On the whole, we conclude that these analyses do not substantially increase our 
understanding of the relationships between the educational process and achievement. We 
suspect that further progress in this area would require better data on the home environ- 
ment, teacher, and classroom behaviors. 

In the previous chapters, we studied the characteristics of educational process that are effective in 
promoting achievement regardless of student backgrounds. We now extend our investigations to 
consider how student characteristics can influence the effects of educational methods. The primary 
goal is to find some consistency in the relationships between educational process and achievement 
so as to help us implement changes that can be expected to effect greater achievement. 

Toward this end, the relationships between instructional services and achievement growth were 
examined, in Chapters 3 and 4, with special emphasis on the achievement of CE students. The 
search for effective educational processes was broadened in Chapter 6, where we considered all 
students and included characteristics of teachers, classroom practices, school conditions, and 
policies of organizing instructional classes. In each analysis, we also employed student 
characteristics, such as race/ethnicity and poverty, to control for their preexisting differences with 
respect to achievement. As few findings were satisfactorily consistent and significant, the issue was 
addressed further in Chapter 7 by contrasting the educational experiences of students having 
relatively 'high' and 'low' growth. Although we found some characteristics of educational programs 
that separated students with 'high' growth from those with 'low' growth, the results were again not 
consistent and meaningful for the purpose of devising a comprehensive achievement model. 
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In this chapter, we continue our inquiry in this regard by focusing on the differences in the effects of 
various educational dimensions among students having different characteristics. We suspect that 
the previous findings are inconsistent and lack meaning because we have not taken into account 
differential effects according to student characteristics. Sometimes, the effect of an educational 
variable on achievement varies (and even changes its direction) depending on the characteristics of 
students. In such cases, the analysis that examines the overall effect of a variable, disregarding the 
differen.ee in student characteristics, can produce inconsistent findings over grades (because of 
varyingjstudent compositions) or fail to reveal the effect. 

Recently, a study by Summers and Wolfe (1977) concluded that there was considerable variation in 
the effects of some school inputs among students grouped by race, income, or achievement level. 
\ln the present analyses, we hope to gain a better understanding of the effective educational pro- 
C cesses by examining their effects according to certain student characteristics that may intervene or 
moderate the relationship between achievement and educational experiences. It is important to 
note that, from a scientific point of view, the approach ' represents an improvement of model 
specification that may lead to a clearer view of reality. However, from a political point of view, it can 
sometimes be misperceived as advocating that subgroups of children are different in how they 
respond to education (which might lead to a recommendation for separate and unequal educa- 
tional services-a condition not legally acceptable). Despite this concern, we take the approach 
with a conviction that the increased knowledge, if uncovered, is important in itself, and will be 
carefully considered by policy makers. Only by recognizing the differential effects, if they exist, can 
educators design programs that best serve their students. 

The present analyses are aimed at determining if the effects of instruction and educational practices 
on achievement are dependent on student characteristics. In other words, we explore the possibil- 
ity that different types of children benefit differently in their achievement growth from the various 
dimensions of educational process (see Jensen, 1969; Bereiter and Engelmann, 1966, for points of 
view in line with this thinking). We study this question through a regression approach with analysis 
steps parallel to those of Chapter 6. An alternative approach would be to perform subgroup 
analyses, i.e., to estimate the effects of educational variables for each subgroup separately. 
However, joint consideration of student characteristics would result in a large number of subgroups 
such that the computational work would quickly become very time consuming and costly. 

In order to keep the analysis simple and manageable, we assume that the main effects of student 
characteristics and the interaction effects of each educational process variable with student 
characteristics are additive. This kind of model is reasonable considering that our previous analyses 
(see Chapter 2) found little interaction between student characteristics in predicting achievement 
scores. Moreover, the number of higher-order interaction terms can multiply rapidly, and these 
interaction terms often correlate substantially with lower-order terms so that their estimations are 
likely to be unstable. Thus, the adopted regression model represents a practical compromise. 

In addition to the student characteristics used in th<? analyses of Chapter 6as control variables, a few 
others are added. All the student characteristics are briefly described here for reference. (The first 
six are based on the report of homeroom teachers in the Study Background Checklist; see Chapter 4 
of Report 9 for further details.) 

• Race/Ethnicity. A dichotomous variable indicating whether the student is non-Hispanic white 
(- 1) or minority (-J9). 

• Participation in Meals Program A dichotomous variable indicating whether the student par- 
ticipates in a free or reduced-price meals program. This variable serves as a proxy for family 
economic status. 

• Previous Receipt of CE A variable indicating whether the student received CE services 
(separately for reading and for math) in the 1975-76 school year, i.e., prior to the year in 
which the data for this report were collected. 
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• Teacher judgment of Need for CE. An index, separate for reading and for math, indicating 
each student's homeroom teacher's judgment of whether or not the student needs CE ser- 
vices. 

• Mother's Educational Attainment. A variable indicating whether the student's mother com- 
pleted high school. This variable serves as a proxy for home intellectual environment. 

• Parental Involvement in School Activities and Child's Education. An index of the amount of 
involvement and interaction each student's parent(s) had >>vith the school during the school 
year. 

• Summer Intellectual Experience, A variance indicating the amount of activities each student 
engaged in during the summer that had academic or intellectual components, obtained 
separately for reading and math. (This index is derived from the Summer Activity Slipsheet.) 

• CE Status. An index of whether the student received reading or math CE services (separately) 
in the 1976-77 school years, based on school coordinators' response on the Compensatory 
Education Roster. 

The pretest score is also used to adjust for initial differences in achievement. The instructional ser- 
vices are measured in terms of yearly hours spent in each of the three instructional settings as 
explained in Figure 6-1 . The set of educational process variables used is different for each grade and 
each subject, and is the same as that employed to examine the combined effects of characteristics of 
educational programs on achievement (see Tables 6-7 and 6-8 for reading and math respectively). 
The analysis steps,parallel those of Chapter 6 insofar as the regression analyses are performed in a 
hierarchical stepwise fashion. 

No clear picture emerges from our analyses concerning the nature of the interaction effects 
between student characteristics and the educational process on achievement. Only a few educa- 
tional variables interact with student characteristics to produce differential effects on achievement. 
In such cases, the interactions, though significant, are generally small and not clearly interpretable. 
How the effects of the educational process vary with student characteristics remain an open ques- 
tion. Nevertheless, w; attempt to offer some possible interpretations of the significant interactions 
in order to aid future inquiries into this area. 

EXPLORATORY ANALYSES OF INTERACTIONS WITH STUDENT 
CHARACTERISTICS 

As in Chapter 6, we first attempt to clear the field a bit by performing preliminary analyses with a 1 5 
percent random sample from the data for each grade. The reason for the preliminary analyses is 
economic: the total number of independent variables is very large when all possible first-order inter- 
actions between the student characteristics and the educational variables are examined. The model 
would include hundreds of regression variables, and the results, in additnn to being very costly, 
would also be difficult to interpret because of the complex interrelationships (intercorrelations) 
among so many predictors. Therefore, the data for the 1 5 percent random samples are analyzed first 
to select important interactions between each of the five sets of educational variables (kinds and 
amounts of instruction, instructional personnel, educational environment, educational practices, 
and classroom organization) and the eight student characteristics. 

The present approach to the study of these interactions requires the generation of the equivalent of 
'interaction terms' (Cohen and Cohen, 1975; Neter and Wasserman, 1974) for the regression 
models. The interaction term for an education variable 'A' with student characteristics 'Z', for exam- 
ple, is the algebraic product of multiplying each student's value for 'A' by his/her value for 'Z', so 
that a new variable, 'A x Z,' is created . These interaction terms are then added to the list of variables 
that will be used as predictors of achievement or achievement growth. 
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Analysis Procedures. The analyses were performed for each grade and for each subject separately. 
At the first stage, five subanalyses, one for each of the five sets of interaction terms associated with 
the above five $ets of educational variables, were carried out in parallel ways in each case. At each 
step of the selection procedure, the model always includes the following variables: the pretest 
score, student background characteristics, instructional-service variables, and the set of 
educational-process variables selected previously for the respective grade and subject (see Tables 
6-17 and 6-18). In the presence of all these 'main effect' terms, the interaction terms between stu- 
dent characteristics and the educational variables were examined separately for each of the five sets 
to determine which interactions will be retained for further analyses. A significance level of .05 was 
used as the criterion for the forward selection and backward elimination strategy. 



In total, there were 60 such regression analyses performed (two subjects x six grades x five sets of 
interactions). Each of these analyses includes a large number of regressions. Because of the 
voluminous results of these analyses, we report only the summary findings in Appendix H (see Table 
H-1 for reading and Tabie H-2 for math). These tables indicate which of the interaction terms 
entered their respective regression equations with significant contributions. 

Once a subset of significant interactions was determined for each of the five educational dimen- 
sions, these subsets of interactions were examined simultaneously in a second-stage analysis so that 
their interrelationships can be taken into account in selecting the final analysis model. Again, all 
main-effect terms included in the first-stage analyses were entered first to the regression model, and 
then the interaction terms were introduced into the regression model via the stepwise procedure. 
The interactions that remained significant for the prediction of achievement growth in this last 
analysis step were selected for subsequent analyses. The interactions so selected are indicated in 
Tables H-1 and H-2 with double checks (*^). 

A single check in the entry of these tables shows that the corresponding interaction term was 
selected in the first screening stage that examined the five sets of interactions separately, but not in 
the second stage when all five subsets of retained interactions were considered jointly. 

Results of the Preliminary Analysis for Reading. From Table H-1, it may be seen by inspecting the 
number of checks in each column that 'Judged Need for CE' and 'Parental Involvement' are most 
likely to interact with various characteristics of educational processes to produce differential effects 
of the latter on achievement growth. Teacher's Judgment of Need for CE is closely related to Stu- 
dent's Achievement Level, the present result implies likely interactions of the educational-process 
variables with achievement level. Differential effects of educational methods by achievement level 
are often a concern of researchers (e.g., Summers and Wolfe, 1977) and will be examined in our 
later analyses through these interaction terms. 

When the rows in Table H-1 are inspected, we find that within a grade, few of the educational 
variables interact with more than two student characteristics. Furthermore, with only one excep- 
tion, none of the educational variables interacts with the same student characteristics in more than 
one grade. (The lone exception is that the interaction between teacher experience and student CE 
status is significant at the .05 level in grades 1 and 3.) The infrequent observation of significant in- 
teractions and the lack of consistent results over grades suggest that the differences in the effects of 
these educational variables among different groups of students are not prominent. 

In general, an interaction that is significant when each set of interactions pertaining to a particular 
educational dimension is considered alone (marked with **) tends to remain significant when inter- 
actions from all five sets are considered together. Thus, there is little evidence that the interaction ef- 
fects between each of the five educational dimensions and the student characteristics are substan- 
tially intercorrelated. 

Results of the Preliminary Analyses for Math. The results for the math analyses, reported in Table 
H-2, indicate that the student characteristics interacting most frequently with the educational 
variables for the latter to affect achievement growth are 'Judged Need for CE' and 'CE Status in 
197677'. It is interesting to note that both characteristics are closely associated with achievement 
level. 
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Looking within a grade; it may be seen that again most educational variables interact significantly 
with only one student characteristic. Although there are more significant interactions in math than 
in reading, the results are still very inconsistent across grades. Only the interaction between a 
teacher's experience and a student's race/ethnicity is significant in more than one grade (grades 1 
and 4) at the second selection stags. As in reading, the significances of selected interactions tend to 
be similar regardless of whether the five sets of interactions are examined separately or 
simultaneously. 

Conclusions From the Preliminary Analyses. Based on the preliminary analyses, it is not promising 
that we will find any pronounced interactions between the educational process variables and stu- 
dent characteristics with regard to their effects on achievement growth. The results show little 
evidence that the effects of educational variables vary consistently with student characteristics. The 
different results among the grades reveal no systematic patterns and their implications are not clear. 
Despite the pessimistic outlook, we proceed lo analyze the data for the entire sample with the 
model resulting from the preliminary screening. The results are discussed in the next section in an 
effort to improve our understanding of the nature of effective educational processes. 

THE INTERACTIONS BETWEEN EDUCATIONAL PROCESSES 
AND STUDENT CHARACTERISTICS 

We now analyze the data for the entire sample usingthe model selected in the preliminary analyses 
in order to study how the effects of educational processes vary with student characteristics. The 
basic model includes the pretest score, the eight student characteristics described at the beginning 
of this chapter, and the educational-process variables shown to be related to achievement growth 
(see Tables 6-7 and 6-8) as the independent variables; and the posttest score as the dependent 
variable. The differential effects of the educational variables are examined by expanding the basic 
model to include the interaction terms, selected on the basis of the preliminary screening (see 
Tables H-1 ana H-2), as additional independent variables. For convenient reference in our discus- 
sion, this expanded model is referred to as the model with interaction; the basic model is referred to 
as the model without interaction. 

The interaction effects are assessed in terms of the regression coefficients for the interaction terms 
and their unique contributions to the explanation of the variance in posttest scores. The results are 
interpreted with special emphasis on how the effects of the educational variables are related to stu- 
dent characteristics. 

Findings From the Fteadmg Analyses. Table H-3 of Appendix H presents the results from the reading 
analyses based on the model with interactions (using data for the entire sample). The increments to 
N squared multiple correlation (R2) by the interaction terms collectively are not at all substantial, rang- 
ing from near 0.0 to 0.4 percent, with smaller increments at the higher grades. Further, it may be 
noted that the regression coefficients for the 'main-effect' variables do not change much in value or 
sign from the analysis in Chapter 6, where the model assumes no interaction between student 
characteristics and educational processes (see Table 8-1 for a summary). We conclude, therefore, 
that we do not substantially improve our understanding of the effects of the educational dimensions 
by considering their interactions with the characteristics of the students. 

Nonetheless, the unique contributions of the combined interaction terms are statistically significant 
except in grade 4. The regression coefficients for some of the interactions are also significant. (Note 
that a significance level of .01, instead of the .05 used in the preliminary selection procedures, was 
adopted for the present discussion because of the large sample sizes.) To provide at least a partial 
cross-validation of these results, identical analyses were also performed using data from the 15 per- 
cent random samples that constitute the data base of our preliminary analyses (henceforth referred 
to as the reduced sample). Similar results for these reduced-sample analyses are presented in Table 
H-4 of Appendix H. 




Table 8-1 



Significant Regression Coefficients for the Educational Process Variables and Their Signs 
as Determined by the Analyses With and Without Interactions, for Reading and Math by Grade 
(Based on Results From the Analyses Using the Entire Sample)t 



Educational Variables 
Significant at the .01 Level 


Reading by Grade 


Math by Grade 


1 


2 3 4 5 


6 


1 


2 3 


4 


5 


6 


Regular Instruction 


+ 


+ + 






+ * +* 


+* 


+ 


+ 


Special Instruction 


+* 


-** -** 








+ 






Tutor/Independent Work 


+ 






+ 


+ * 


+ * 


+ 




Staff/Student Ratio 




+* 














Support/Teaching Personnel Ratio 






- 










- 


Years of Teaching 


+ 


+ + + 




+ 


+ 


-* 


+ 


+ 


Highest Degree Earned 




+ 














Recent Inservice Training 






+ 




-** 








Belief in Schooling 








+ 








- 


Attitude to School Programs 














+ 




School's Minority Concentration 




+ 






+ +** 


+ 






School l s Poverty Concentration 














+ 


+ * 


School* s CE Concentration 


+ 


+ 








- 






School's Low-Achiever Concentration 




- 


- 


- 


- 


- 


- 




School's Central Resources 


+ 






+ 










Pa rent /Community Involvement 


-+ 


+ 










+ 




District Control of Instruction 


+* 
















Principal's Instructional Leadership 


+ * * 
















Teacher's Involvement in Decisions 














-* * 




Disturbance of Instruction 


+ 
















District's Percent of Administrative Staff 




+ 






+ 








Effort in Planning and Evaluation 




+** 














Teacher's Use of Lesson Plans 








-* 






+ 




Frequency of Feedback per Semester 










+ 






+ 


Weekly Homework Assigned 


+ ** 




+ 


+ 




+ * 




+ 


Monthly Use of Materials 










+ 








Individualization of Instruction 












-** 




+ 


Monthly Use of Audio-Visual Equipment 




-** 














Extent of Ability Grouping 



















The results of analyses without interactions were extracted from Tables 6-7 and 6-8, while the results of analyses wi 

interactions were extracted from Tabl H-3 and H-5 of Appendix H, for reading and math, respectively. In the analyse 

without interactions, a few student characteristics were also omitted. 
■^Reversal of the sign of the regression coefficients in the two analyses: the first sign indicates that obtained in t. 

analysis without interactions, and the second indicates that obtained in the analysis with interactions. 
*<;inn if inant only in the analyses with interactions, 
•^p.y^.jant only in the analyses without interactions. 

J^l^j^risks in the entry indicates significance in both analyses. ^ r> gj f ) 



Inspection of Tables H-3 and H-4 reveals that the squared multiple correlations for both models 
with and without interactions are comparable between the reduced-sample and the whole-sample 
analyses. The largest discrepancy between'the two analyses is found in grade 1 when the model 
with interactions is applied (R2 - .531 and .482 for the reduced and the whole sample, 
respectively). In all other cases, the discrepancies are either about or less than 1 percent. Addi- 
tionally, the significances of the unique contributions by the interactions collectively are also similar 
between the two analyses using different samples; but the estimates of the interaction effects differ 
considerably between the samples (see more discussion later). 

In order to see how the inclusion of the interaction terms and the additional student characteristics 
into the present analyses would affect the estimates of the regression coefficients for the educational 
variables, we compare, in Table 8-1, the signs and significances of the common educational 
variables used in the analyses presented in Tables 6-7 and H-3 for reading. (In the same table, we 
also compare the corresponding data for math by summarizing results in Tables 6-8 and H-5.) From 
Table 8-1, it may be seen that in reading there are 37 significances found for all six grades and all 
educationatVariables involved in the two analyses. Among these significant coefficients, four are 
significant only in the present analyses (Table H-3), six are significant only in the analyses presented 
in Chapter 6 (Table 6-7), and one is significant in both analyses but with a reversal of sign. 

Inspection of Tables 6 7 and H-3 reveals that the signs of the coefficients for Parent/Community 
Involvement in grade 1 are different largely as a result of the interaction between this variable and 
the White/Minority status. The negative coefficient for this interaction implies that minority students 
benefit more from Parent/Community Involvement than do the Whites. Hence, tiie estimate of the 
" main effect for this variable can vanish or become negative if white students do not benefit from it 
and the interaction is not considered. This is so because the sample includes more whites than 
minorities as it should in order to reflect the composition of the population. 

The remaining 26 significance* are in agreement between the two analyses. Overall, these com- 
parisons show that the estimates for the effects of the educational variables a e quite robust, another 
confirmation that interactions contribute little to the explanatory power of the model. 

For the regression coefficients, Table 8-2 summarizes the significant interactions found in the 
reading analyses using the reduced and the whole sample. Data in this table show considerable 
disagreement between the results of the two analyses. Amongthe ten significant interactions in the 
six grades, two were significant only for the reduced sample and three were significant only for the 
whole sample. This leaves only five occasions f hat are in agreement between the samples. One nor- 
mally expects many more significances when the extremely large sample (the whole sample) is 
used, but such an expectation cannot be confirmed unequivocally by these data. The lack of con- 
gruence in the two sets of results regarding interactions suggests that the estimates of the regression 
coefficients for these interactions could be quite unstable. For this reason, only the five interactions 
that show significance in both samples are interpreted: 

• Interaction Between Parent/Commun/ty Involvement in School Programs and Student's 
White/Minority Status. In grade 1, the negative coefficients for this interaction and the 
positive coefficients for the main effects of Parent/Community Involvement together imply 
that minority students benefit more from a program that encourages Parent/Community in- 
volvement. It cou'd be because of the emphasis of such involvement in CE programs (Title I 
in particular) that serve primarily minority, poor, and low-achieving students. 

• Interaction Between School Low-Achiever Concentration and Student Need for CE. in grade 
3, the main effect of school's low-achiever concentration is negative and the interaction bet- 
ween Low-Achiever Concentration and CE Need has a positive regression coefficient. These 
observations reveal that the condition of high concentration of low achievers in the school 
has less perverse effects on the achievement growth of students judged to have need for CE. 
This is presumably because of the greater likelihood for the students with educational need 
to receive additional help such as CE. 
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Table 8*2 



Significant Interaction Effects Between Student Characteristics and 
the Educational Process on Reading Achievement 
(Results From the 15 Percent and the Entire Sample) 



Interaction Terms Grade 



Significant at the .01 Level+ 



Highest Degree Earned x PI -* 
Recent Inservice Training x RACE 

School's CE Concentration x NEED +** 
School's Low-Achiever Concentration x NEED + 

School's Low-Achiever Concentration x PI +* 

Parent Community Involvement x RACE 

Disturbance of Instruction x PI -** 
Disturbance of Instruction x SUMI + 
Effort in Planning and Evaluation x CE76 V + 

Weekly Homework Assigned x PI -* 



PI = Parental Involvement in child's education; RACE = 1 for Non-Hispanic 

Whites and 0 otherwise; NEED = Teacher's judgment of the student's need for 

reading CE (1 for having the need and 0 otherwise) ; SUMI = Student's summer 

intellectual experience; and CE76 = CE status in 1976-77 (1 for CE students 

and 0 for nOn-CE students) . 
* 

Significant only in the analyses using the entire sample. The plus (or minus) 
- sign in the entry shows ttizt the interaction term has a positive (or negative) 
coefficient. 

** 

Significant only in the analyses using the 15 percent random sample. 

No asterisk in the entry indicates significance in both analyses using the 

15 percent and the entire sample. 

• Interaction Between Disturbance of Instruction in School and Summer Intellectual Experience 
of theStudent. In grade 5, Disturbance of Instruction exhibits negative influences on achieve- 
ment growth but less so for the students with greater intellectual experience during the sum- 
mer. The index for Summer Intellectual Experience primarily reflects summer-school atten- 
dance which is often voluntary. We suspect tha., ceteris paribus, the students who volunteer 
for summer school tend to be more motivated than their similar peers (even among the low- 
achieving students) and may be distracted less from their learning by disturbance in the 
school. As a result, disturbance of instruction might have smaller adverse effects on the 
achievement of students with greater summer intellectual experience. 

• Interaction Between Teacher Effort in Planning and Evaluation and Student CE Status. In 
grade 5, the main effect for Effort in Planning and Evaluation is not significant but there is a 
positive interaction between it and student CE status. This finding indicates that this variable 
is positively associated with the achievement growth of CE students but not for the non-CE 
students. Considering the fact that CE promotes teacher effort in planning and evaluation, 
this result may be regarded as supportive of the benefits of such emphases. 

• Interaction Between Teacher Recent Inservice Training and Student White/Minority Status, In 
grade 6, Recent Inservice Training received by teachers has a positive impact on achieve- 
ment growth and this impact is greater for the minority students than for the whites. Again, 
the finding suggests some connection with CE because of the importance of inservice training 
for teachers in CE programs. 
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In summary, these interactions suggest that the educational aspects that are emphasized by CE pro- 
grams tend to have greater (positive) effects on the achievement of students who are more likely to 
receive CE. However, the findings are so inconsistent across grades, we have little confidence of 
their practical meaning. 

* Finding* From the Math Analyses. The detailed results of the analyses for math are presented in 
Table H-5 of Appendix H. These analyses employed the model with interactions and included the 
entire sample of students. The increments to f?2 by the interactions, although statistically significant 
at all grades, range from only 0.1 to 0.7 percent. As in the regression analyses of Chapter 6 and the 
discriminant analyses of Chapter 7, we observe more significant predictors for math posttest scores 
than for reading. Still, the consideration of the interactions does not substantially increase our 
understanding of how the educational process influences math achievement. 

For the purpose of cross-validation, the same analyses were also performed with data from the 15 
percent random sample used in earlier exploratory analyses. The results of these reduced-sample 
analyses are presented in Table H-6 of Appendix H. Comparison of the data in Tables H-5 and H-6 
reveals that the for the whole sample is always smaller than the corresponding value for the 
reduced sample as often expected (on the basis of the rationale for calculating adjusted R2). The 
increases range from 1 .6 to 4.6 percent when the analyses are based on the model with interactions. 
Both analyses using the reduced sample and the entire sample show consistent significances over 
grades for the unique contributions of the interactions collectively. Comparison of the estimated 
regression coefficients for the interaction terms, however, discloses considerable differences 
between the two analyses (see later discussion). 

The influences of the inclusion of additional student characteristics and the interaction terms into 
the current analyses on the estimates of the regression coefficients for the educational variables can 
be examined by comparing the data in Tables 6-8 and H-5. A summary of the data in these two 
tables.was provided in Table 8-1 to facilitate the comparison. It may be seen from the second part of 
this table (for math) that of the 50 significant coefficients obtained in the analyses either with or 
without interactions for the six grades, ten are significant only when the model includes the interac- 
tions (Table H-5), and five are significant only when the interactions are omitted (Table 6-8). This 
leaves 35 coefficients that are significant and of the same direction in both analyses. As in reading, 
these results suggest that the estimates of the effects of the educational variables are quite robust, in 
o part reflecting the small contributions of the interactions in the prediction of math achievement. 

We now describe the interactions between the educational process and student characteristics by 
examining the regressjon coefficients for the interaction terms. Table 8-3 summarizes the significant 
interactions obtained'in the analyses with the reduced sample (Table H-6) and the whole sample 
(Table H-5). Combining the results for the six grades, we find that in a total of 25 significant interac- 
tions, six are significant only in the whole sample and nine are significant only in the reduced sam- 
ple. The remaining ten coefficients are significant in both samples. Again the discrepant results can- 
not be explained by the anticipation of more significances when the sample size is much larger. 
These findings suggest that estimates of the interaction effects are not stable across samples. To a 
certain extent, this lack of stability is an indication of the tenuous interaction effects being studied., 
Taking the same strategy adopted in cur discussion of the reading analyses, we will interpret only 
the interactions whose significances are consistent between the two samples: 

• Interaction Between Time Spent Working With Tutor or Independently and Student 
White/Mmority Status. In grade 4, the main effect of Tutor/Independent Work is positive but 
there is an interaction between this variable and Race/Ethnicity. The negative coefficient for 
this interaction shows that this kind of instruction does not have as much (positive) impact on 
the achievement of white students as on that of minority students. This is possibly because 
minority students are likely to benefit from additional practice in learning math skills as they 
may not have as much opportunity for practice outside the school. 
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Table 8-3 

Significant Interaction Effects Between Student Characteristics and 
the Educational Process on Math Achievement 
(Results From the 15 Percent and the Entire Sample) 



Interaction Terms 






Grade 






Significant at the .01 Level* 


1 


2 


3 4 


5 


6 


Regular Instruction x NEED 


+** 










Tutor/Independent Work x RACE 













Support/Teaching Personnel Ratio x FMP 
Years of Teaching x RACE 
Years of Teaching x NEED 
Years of Teaching x SUMI 
Recent Inservice Training x MOED 
Belief in Schooling x CE76 



+ * 
+ 



+ ** 



+** 



School's Minority Concentration x NEED 
School's Poverty Concentration x RACE 
School's Poverty Concentration x NEED 
School's Poverty Concentration x PI 



School's CE Concentration x CE75 
School's CE Concentration x NEED 
School's Low-Achiever Concentration x RACE 
School's Low-Achiever Concentration x FMP 
School's Low-Achiever Concentration x CE75 
School's Low-Achiever Concentration x CE76 
Parent/Community Involvement x CE76 
Teacher's Use of Lesson Plans x FMP 
Frequency of Feedback per Semester x NEED 
Weekly Homework Assigned x CE76 
Extent of Ability Grouping x MOED 



+ * 



+ ** 



NEED = Teacher's judgment of need for math CE (1 = yes; 0 = no); RACE = 
White/Minority status (1 for Non-Hispanic White and 0 for all others) ; 
FMP = Participation in free or reduced-price meals programs (1 = ^es, 
$ = no;; SUMI = Summer intellectual experience (amount of summer activities 
that have intellectual components); MOED = Mother's education (1 = comple- 
tion of high school , 0 = otherwise); PI = Parent's involvement in the educa- 
tion of the'r own child; CE75 = Receipts of math CE in 1975-76 (1 = yes, 
0 = no); CE 76 = C£ status in 1976-77 (1 = participating, 0 = not partici- 
pating) . 

*Significant only in the analyses using the entire sample. The plus (or minus) 
sign in the entry shows that the interaction term has a positive (or negative) 
coefficient. 

**Significant only in the analyses using the 15 percent random sample. 

No asterisk in the entry indicates significance in both the 15 percent and 
the entire sample analyses. 
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• Interaction Between Support/T eaching Personnel Ratio and Student Participition in Free-Meat 
Programs (a proxy for family economic status). In grade 5, there is no significant main effect for 
SupportfTeaching Personnel ratio, bufthe variable interacts with student economic status in 
that it has negative impact on the achievement of children from low-income families. This 
reinforces the idea that instruction by teachers is likely to be more effective than other sup- 
portive services for disadvantaged children. 

• Interaction Between Teacher Years of Teaching and Student Judged Need for CE . In grade 4, 
the main effect of Teacher's Experience-is not significant in the analysis without interactions. 
However, the main effect of this variable becomes significantly negative when interactions 
are considered. This is the only case in the six grades that a negative effect is found for 
teacher experience. This deviation from the general pattern miy be explained by the 
significance of its interaction with student need for CE. The positive coefficient for the inter- 
action indicates a tendency for the educationally needy children to benefit, more from 
instruction by more experienced teachers. The overall non-significant effect for this variable 
may then suggest a negative effect for students not in need of CE. This finding does not agree 
with that by Summ.ers and Wolfe (1977) who found that low achievers tend to benefit more 
from reading teachers with three to five years of experience than from those with more years. 
It is important to note, however, that the present finding is for math only, not for reading. 
Beginning at grade 4, new math concepts and computational skills are introduced, and low- 
achieving students are more likely to learn the moje complex concepts from more experi- 
enced teachers, assuming these teachers have acquired better skills for presenting the new 
materials and have greater patience to work with low achievers. In passing, it may also be in- 
teresting to note that more significant interactions are found in grade 4 than in other grades. 

• Interaction Between School Poverty Concentration and Student Judged Need for CE. In 
GradeS , the main effect of school poverty concentration is positive. In addition, this 
variable has greater (positive) effects on achievement for students needing CE than for others. 
In terms of the policy of targeting CE funds to schools with large percentages of children from 
low-income families, this result gives some supportive evidence to the success of this policy. 
That is, the children who are educationally in need and attend schools with high poverty 
concentrations achieve greater growth than similar children attending schools with low 
poverty concentrations (this is an interpretation inferred from the main effect). Moreover, the 
interaction effect shows that the educationally needy children benefit more from being in 
schools of high poverty concentrations than their non-needy peers (who most likely do not 
receive CE). 

• Interaction Between School CE Concentration and Student Previous Receipt of CE. In grade 4, 
the main effect of school CE concentration is negative. There is also a negative interaction 
effect with previous exposure to CE, suggesting a greater negative impact of this variable on 
the achievement of those who received CE in a previous year than on those who did not. 
This result is difficult to interpret and requires further clarification by the examination of the 
interaction between school CE concentration and student history of CE participation. We are 
concerned that insufficient assistance for chronic low achievers in schools having high con- 
centrations of CE students may be the underlying cause for this interaction. 

• Interaction Between School CE Concentration and Student Judged Need for CE. In grade 4, 
the negative main effect for school CE concentration * rid the positive coefficient for its inter- 
action with student CE Need suggest that high concentration of CE students in the school ex- 
hibits less adverse effects for the educationally needy children than for the non-needy. This 
condition in the school may quite likely not be conducive to learning, but such perverse 
effects may be partially counteracted for students in need of CE as they tend to be those 
receiving CE. 

• Interaction Between School Low-Achiever Concentration and Student White/Minority Status. 
In grade 3, the main effect of School LoW-Achievei Concentration is negative and this 



ERLC 



225 



253 



negative effect is more pronounced for white students than for minority students as indicated 
by the negative coefficient for its interaction with the white/minority variable. This finding 
may be related to the greater likelihood for minority students to receive CE and to benefit 
frpm the compensatory assistance. 

* Interaction Between School Low-Ach/ever concentration and Student Previous Receipt of CE . 
* In grade 3, the main effect of School Low-Achiever Concentration is negative, but for the 

f students who have previous exposure to CE (in 1975-76) this negative main effect is reduced as 
implied by the positive coefficient for its interaction with CE receipt in the previous year. If one 
considers the substantial proportion of students who continue to receive CE from year to year 
(see Report 5), one may tKink that this result is possibly related to the effects of CE in the 'cur- 
rent year' (1976-77), But the nature of this interaction requires further study by examining the 
relationship between the effects of schdol low-achiever concentration and the effect of CE par- 
ticipation history.., . 

• Interaction Between School Low-Ach/ever Concentration and Student CE Status. In grades 1 
and 2, the main effect J School Low-Achiever Concentration is negative. However, this 
variable interacts with CE statu?differently iothe two grades. In grade 1 , CE participation tends 
to counteract some of the negative main effect, while it terids lo accentuate the negative effect 
in grade 2. We can't quite figure out what the implications are for the latter case of negative 
interaction* The positive interaction" in grade 1 could possibly be related to CE effects. 

In summary, there are more significant interaction effects between the educational-process 
variables and student characteristics for math achievement than for reading. Similar to the case in 
reading, these interaction effects at times offer some insight into the effects of educational processes 
and appear to have some connections with CE programs. But this is not the general case^and often 
the relationships are weak and the implications are, ambiguous. Most of the interaction effects 
involve the compositional variables that describe the existing condition^ of the school and, unlike 
the operational characteristics of educational practices, are not subject to easy manipulation. That 
we are not able to find |he same interaction effects in more than one grade (when interaction effects 
apply to more than one grade, such as in the last item discussed above, the differences between 
them cannot be meaningfully interpreted) discourages us from taking the findings seriously. 

Conclusions. For both reading and math, the results of the present analyses do not offer much' 
insight into what differential effects the characteristics of educational programs may have on the 
achievement growth of different groups of students. Our understanding of the relationships 
between educational inputs and achievement growth is not substantially improved witb the infor- 
mation accumulated from the results reported in these last three chapters. Considering our failure to . 
obtain findings that are of consistent pattern or that show meaningful differences among grades, we 
hesitate to make any definitive conclusions that may inappropriately influence the decisions of 
educational policy-makers. 

THE CHARACTERISTICS OF EFFECTIVE EDUCATIONAL PROCESS FOR CE STUDENTS 

The analyses in the preceding section peripherally suggest that the interactions between the educa- 
tional process and student characteristics, if they exist, tend to have some connection with CE pro- 
grams. Considering thfs suggestion and <^ur interest in identifying the characteristics of the educa- 
tional process that facilitate the success of CE programs, we further examine the nature of effective 
educational processes by focusing on the achievement of CE students. For this purpose, two groups " 
of CE students having 'high' and 'low' achievement growth are defined, and the same discriminant 
analysis described in Chapter 7 is applied to determine the dimensions of the educational prpcess 
that differentiate between the educational experiences of these two groups. Our objective is to 
learn Whether effective processes for CE students differ Jn any way from those for the general 
population. 
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Student Grouping on the Basis of Achievement Growth 

The bases for assigning CE students to the analysis groups differ sligntly from those used in the last 

* chapter Jo classify all students. Our interest now is to differentiate two groups of CE students who 
achieve relatively higher and lowerthan the average of a standard group of students who are similar 
to them but do not receive CE. Withlhis reference to the average gain of a standard group, we can 
think of thesejtwo groups of CE students as being 'successful' and 'unsuccessful' with regard to clos- 
ing.the anticipated gap between them and their non-disadvantaged peers. 

A 

The standard group used here is one of the comparison group defined in Chapter 2: the group of 
students who attended non-CE schools and were judged to have need for CE. (See Chapter 2 for an 
explanation of the usefulness of this group for the pyrpose of generatingthe expected growth for CE 
"students in the absence of CE.) This standard group is separately defined for reading and math. The 
sample-statistics for the distribution of fall-to-spring achievement gains in this group provided the 
bases for assigning CE students to 'high' and 'low' growth groups; these statistics are presented in 
. Table H-7 of Appendix H for reference. 

* ' Definition of Growth droups. Both gains in terms of z-score and, VSS (see Chapter 7) were con- 
sidered in the process of assigning group membership. Fot each kind of score, if a CE student 
attained a gain exceeding the mean gain for the standard group by at least one standard deviation 
(s.d.), then he/she was assigned to the category of "'high' growth. Conversely, if a CE student had a 

* gain falling below the same mean by at least dne s.d., he/she was assigned to the category of 'low' 

* f growth. Tno rest erf CE students were assigned to the category of 'intermediate' growth. 

the two assignments made on the bases of z-score and VSS gains were employed jointly to define 
the analysis groups. Explicitly, the group of 'high' growth consisted, df CE students who were 
assigned to the 'high' growth category on both bases. Jhe group of 'low' growth was composed of 
CE students who were assigned to the 'low' growth category in terms of both z-score and VSS gains. 
A" .the remaining students belonged to the intermediate group of 'comparable' growth because 
thehr^gains were judged to be, more or less 'comparable' to those of the students in the standard 
! group. \his last group was dropped in the discriminant analysis. 

The Relationship Between Achievement Crotvttt at)d Category of C£ Programs, Table 8-4 presents the 
ratios of the number of CE students in the high-growth group to tfiat in thelow-growth group, as a 
way of examining t\\e relative, success rates among the three categories of CE programs. Title I 
students generally have the greatest success rates (with few exceptions), and there is a consistent 
tendency that they are more likely to be in the high-growth group than in the low-growth group 
(he./ the ratios exceed 1.0). the actual numbers and percentages of Ct students in each grbwth 
group by CE categories can be found in Table H-8 of Appendix H, along with summaries of chi- 
square statistics for the association betyveen CE category and growth group. 

It is interesting to note that, combining all three categories of reading CE students, the proportions of 
thern with 'high' growth tends to decrease with increasing grade, with an interruption in grade 4. 
The upper three grades have somewhat greater propbrtions of students with 'low' growth. This 
finding is consistent with findings reported earlier in Chapter 2, that the effects of reading CE are 
noticeable primarily in the lower grades'. Fpr math,. the overall proportions of CE students wirti 
• 'high' growth are the 'vgest in the first two grades, decrease in grades 3 and 4, and then increase 
again in grades S and 6. It shoyid also be noted that the ratios of the proportions in the two groups 
are generally higher for math than for reading, supporting earlier findings of greater CE effects in 
" matft... ' . * 

Differences Between the Growth Croups wtth^Respect to Educational ExperieQces. As supplemental 
information, we compare the educational process experienced by the high-growth and low-growth 
groups in terms of the means for the set of educational variables that will be used as potential 
discriminators for the two groups in the subsequent analyses. These means are presented in Appen- 
dix H, Table H-9for reading and Table H-1Qfor math. These data are intended for description of the 
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Table 8-4 



Ratios of the Number of CE Students Having 'Higher-Than-Expected' 
Growth to That Having 'Lower-Than-Expected' Growth, 
for Three Categories of CE Students by Grade* 



UL aUc 




CE Category 
















Other-CE 


Students 


Students in 




in Title T Schools 


in Title 


I Schools 


in Other-CE Schools 


< 




Reading 






1 


1 .77 


i 
i 


.b / 


1.03 


2 


1.59 


i 
i 


. £<> 


2.09 


3 


1 .79 




.88 


1.78 


4 


1.03 




.81 


.90 


5 


1.17 




.83 


1.41 


6 


1,04 


1 


.08 


.56 






Math 






1 


2.86 


1 


.68 


2.47 


2 


1,77 


1 


.78 


1.86 


3 


1,88 




.84 


.63 


4 


1,81 




.91 


.49 


5 


2.06 




.94 


1.58 


6 


2.12 


1 


.73 


1.18 



*Fall-to-spring growth is defined as 'higher-than-expected 1 if it is one 
standard deviation or more above the average growth for non-CE students judged 
to have need for CE but attending schools t^hat do not provide CF in the sub- 
ject area. Fall-to-spring growth is 1 lower^-than-expected 1 if it is one stan- 
dard deviation or more below that same mean. 



different educational programs for the two groups, and to aid us in the interpretation of the results 
from the discriminant analyses. It should be emphasized that no inference regarding the 
characteristics of effective programs can be made properly by looking at the mean differences for 
the variables separately, these differences will be examined jointly in the discriminant analysis for 
the purpose of making such inferences. 

For reading, the average hours of instruction received do not differ significantly between the two 
groups, except that in grade 1 the 'high' growth group tends to receive more hours of regular 
instruction. In grades 1, 2, and 5, the Support/Teaching Personnel Ratio is smaller for the 'high' 
growth group. For all other variables, the mean differences tend to be significant only in grade 1 . For 
this grade, the 'high' growth group tends to be in schools with more inservice training for teachers, 
higher concentrations of minorities, CE students, and low achievers, greater extent of parent/com- 
munity involvement, stronger principal leadership for the instructional program, more effort in plan- 
ning and evaluation, more homework assigned, more use of materials, and more use of audio-visual 
equipment. 

For math, in grades 1 and 4, CE students in the 'high' growth group on the average receive more 
special instruction, and, in grades 1 and 5, they spend more time working with tutors or 
independently. In general, there is not much difference in the hours of instruction received 
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between the two groups, except for grade 1 1 . Again, as in reading, differences between the groups 
are found for more variables in grade 1 than for any other grade. School CE concentration is higher 
for the 'high' growth group in grade 1, but lower for that group in grades 3, 4, and 5. Elsewhere, the 
mean difference^ between groups vary considerably and unsystematically with grades. 

In addition to the educational process variables, we also compare the pretest achievement and 
Title I participation rate between the 'high' and 'low' growth groups of CE students. From Tables 
H-9 and H-10, we find that for both reading and math the high-growth group tends to have lower 
pretest scores than the low-growth group, and greater Title I participation rate. The lo.wer pretest 
scores for students of higher growth suggest that the finding may be partially a result of the 
regression -toward-the-mean phenomenon, as noted also in Chapter 7. 

Discriminant Analysis in Order to Identify the Characteristics of Effective 
Programs for CE Students / 

Analysis Procedure. The analysis follows the same stepwise procedure described in, Chapter 7. The 
same set of educational variables serves as the potential discriminators between the growth groups 
(see Tables H-9 and H-10 for lists of these variables). Additionally, in order to control further the 
pretest differences among students, the pretest quartile is also included in the analysis. Because the 
analysis considers only CE students, the CE-status variable used previously in Chapter 7 is replaced 
with a variable that indicates student participation in Title I programs. The purpose of including this 
last variable is to control for unobserved differences between Title I and Non-Title I programs, while 
we attempt to determine which of the observed characteristics are effective in promoting 
achievement. 

Results of the Analyses for Reading. Table 8-5 summarizes the results of the stepwise discriminant 
analyses for reading. In this table, we present the entry order of the selected discriminators and their 
coefficients in the resulting discriminant function, the mean discriminant scores for each group, test 
statistics for the discriminating power of the function, and percents of correct classification using this 
function. 

In the fast section of the table, two indexes are provided for the discriminating power of the 
discriminant function that encompasses all ihe original 28 potential discriminators. Comparison of 
the canonical correlation and percentages of correct classification betweeen the selected discrimi- 
nant function and that using all 28 variables discloses that the addition of variables that were not 
selected in the stepwise procedure does not substantially improve the discriminant power. The 
increase in percentages of correct classification ranges from 0.2 percent at grade 1 to 3.1 percent at 
grade 6. This increase tends to be larger at the upper grades with an exception for grade 3. It may 
also be noted that both the canonical correlation and the percentage of correct classifications are 
considerably smaller for the upper three grades than for the lower grades. This phenomenon is con- 
sistent with the finding that substantial CE effects are not evident in these three grades (see Chap- 
ters?). 
\ 

With jfespect to the instruction received, we find from Table 8-5 ti at only in grade 1 does amount of 
re*)gt*Jar instruction contribute to the distinction between the two growth groups (it is associated with 
'high' growth). Amount of tutor/independent work distinguishes between the two groups in four 
grades (grades 1, 2, 3, and 6) in that it is positively related to growth. Amount of special instruction, 
on the other hand, shews some negative relationships to growth in grades 2 .and 3. 

Turning to other dimensions of the educational process, two variables that reflect conditions of the 
school differentiate the 'high' from the 'low' growth group fairly consistently. School's CE Concen- 
tration tends to be related to 'high' growth in grades 1 and 4, while School's Low-Achiever Concen- 
tration tends to exhibit adverse relationships with growth in grades 3, 4, and 5. Among the teacher- 
level variables, Years of Teaching (in all grades except grade 5) and Effort in Planning and Evaluation 
(in grades 1, 3, and 5) show noticeable associations with 'high' growth. 
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v Table 8-5 

X \ Stepwise Two-Group ('High' vs. 'Low' Fall-to-Spring Growth) Discriminant Analyses for 
\ Examining the Effects of Instructional Services Received, and Characteristics of 
\ Educational Process on the Reading Achievement Growth of CE Students* 


Discriminating Variables 
Selected by the* Stepwise 
Discriminant Procedure 






Standardized 


Discriminant Function Coefficients 


(Beta) 








Grade 


1 


Grade 2 


Grade 


3 


Grade 


4 


G^ade 


5 


Grade 


6 


Entry 
Order 


Beta 


!r; ry Beta 
Order 


Entry 
Order 


Beta 


Entry 
Order 


Beta 


Fnt ry 
Order 


Beta 


Entry 
Order 


Beta 


Student Character 1 st ics 






















-.71 


Pretest Achievement Quartile 


I 


" . 61 


1 -.92 


1 


1 .04 


1 


- .86 


1 


-.53 


1 


Instructional Services Received 
























Regular Instruction 


5 


.20 


NA 


NA 




NA 




NA 




NA 




Special Instruction 


NA 




3 - .27 


2 


-.19 


NA 




NA 




NA 




Tutor/Independent Work 


6 


.21 


5 .19 


4 


.20 


NA 




NA 




4 


. 43 


Characteristics of Educational Process 
























Staff/Student Ratio 


NA 




NA 


NA 




NA 




4 


- .40 


NA 




Support/Teaching Personnel Ratio 


NA 




NA 


NA 




NA 




3 


- . 27 


NA 


.46 


Years of Teaching 


10 


. 1 2 


7 .21 


3 


. 16 


6 


.26 


NA 




3 


Recent Inservice Training 




. 28 


NA 


NA 




NA 




NA 




NA 




School's Minority Concentration 


NA 




4 - . 41 


NA 




NA 




6 


.73 


NA 




School ' s CE Concent rat ion 




.46 


6 .28 




. 29 


7 


. 28 


NA 


-.53 


NA 




School's Low-Achiever Concentration 


NA 




HA 


7 


- . 22 


5 


- .44 


7 


NA 




School's Central Resources 




.15 




NA 




4 


. 30 


NA 




NA 






NA 




8 .22 


NA 




3 


- .29 


NA 




NA 




Principal's Instructional Leadership 


NA 




NA 


b 


- . 17 


NA 




NA 


-.59 


NA 




Disturbance of Instruction 


NA 




NA 


NA 




NA 




2 


NA 




District's Percent of *dnuni-»trative Z*-aff 


NA 




2 - .24 


NA 




2 


_ „ 36 


NA 




NA 




Effort in Planning and Evaluation 




. 19 




3 


.15 


MA 




5 


.27 


NA 


.40 


Teacher's Use of Lesson Plans 






r\ 


NA 




NA 




NA 




2 


Monthly Use of Materials 


7 


. 16 


NA 


NA 




NA 




NA 




NA 




Classroom Achievement Level 


9 


.13 


NA 


NA 




NA 




NA 




NA 




Statistics for the Discriminant Function 




















N 




Mean Discriminant Scores 


N 


Mean 


N Mean 


N 


Mean 




Mean 


N 


Mean 


Mean 


'High' Growth Groufr 


564 


.404 


559 . 365 


S01 


.361 


475 


.271 


362 


.266 


298 


.248 


'Low' Growth Group 


no 


-.691 


359 - 568 




-,618 


475 


-.271 


301 


-.320 


304 


-.243 


Milk's Lambda 


.7: 


1 


.792 


. 77 


7 


.93 


7 


.91 


5 


.940 


Chi-Square Test Statistics** 




.8 


212,2 


199 


.3 


72 


1 


58. 


8 

.085) 


» J7. 


i 


Canonical Correlation (Squared) 


529 


.280) 


.456 (.208) 


.473 


.224) 


271 


.073) 


.292 


.246 ( 


.061 


Percent of Correct Classification 


75 


.4 


71.5 


71 


.4 


63 


.6 


61 


.2 


59 


.5 


When all 28 Potential Discriminators are used 

Canonical Correlation (Squared) 
Percent of Correct Classification 


.553 ( 
75. 


. 306) 
6 


.477 (.228) 
72.1 


.491 ( 
72 . 


.241) 

9 


.317 ( 
64. 


.100) 
2 


.344 ( 
64. 


. 118) 
1 


.327 ( 
62. 


.107) 

6 


*The 'High' and 'Low' growth groups created for this analysis comprise Reading CE students whose Fall-to-Spring growth is at least one s.d 
above and below , respectively, the average for the non-CE students judged to have need for reading CE but attending schools that do not 
r — The potential discriminators employed include pretest achievement status, participation in Title I programs, three kinds of 
i " jial services received, and 23 educational-process variables that were fc.ind to be effective in predicting posttest scores for al 
: |IJ^J^\f the six grades. The selection criteria of the discriminators in the stepwise procedure are 4.0 for 'F-to-Enter' and 3.9 for 

**Degree of freedom • number of discriminator* selected* all chi-squares are significant at tne .01 level. 6 S 
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All other selected variables demonstrate non-negligible discriminability either in one grade only or 
in two non-adjacent grades. In some of the latter cases, a reversal of the direction of relationship is 
obtained. These results of the discriminant analyses present some different pictures from that 
implied in the univariate comparisons of means for the discriminators between the two groups. As 
noted earlier, examination of the mean differences alone cannot always reveal the efficient 
discriminators, due to the multi-variate nature of the problem. 

As the main objective of the present analyses is to determine whether the characteristics of educa- 
tional service and process that help CE students to achieve better are similar to those that are 
generally effective for all elementary students, we now concentrate on the comparisons between 
the current results (Table 8-5) and the results presented in Chapter 7 (Table 7-3). A summary of the 
data given in Tables 7-3 and 8-5 is provided in the first part (for reading) of Table 8-6 for convenient 
reference. 

With respect to instructional services, time spent in regular instruction plays a significant role in 
distinguishing between the two groups more often when the analyses involve all students than 
when they concern only CE students. Amount of tutor/independent work has a noticeable contribu- 
tion to the distinction between the groups in both analyses. For these two kinds of instruction, more 
time is associated with higher growth. 

In contrast, services received in the forms of special instruction differentiate high from low growth in 
grades 1 through 4 for the entire sample with a negative relationship. As explained previously in 
Chapter 6, the policy of providing special instruction primarily to students with special educational 
need may largely explain the unfavorable finding here. When only CE students are considered, the 
negative relationship between amount of special instruction and growth remains statistically signifi- 
cant in grades 2 and 3. This finding might be construed by many as a confirmation of their suspi- 
cions that employment of special teachers and aides, and emphasis of very small classes (1-6) in the 
instructional programs for CE students (see Report 5) are not really effective in raising their achieve- 
ment. It has been suggested, for example, that these types of instruction are not as promising as the 
services offered by regular classroom teachers, particularly because special teachers could have 
been hired with lower qualifications than regular teachers. However, our analyses presented in 
Chapter 3 did not support the speculation that special teachers are less qualified (see Table C1-6 of 
Appendix Q. 

Among other aspects of the educational process, only the finding concerning teacher experience is 
consistent between the samples: students taught by more experienced teachers tend to achieve 
greater growth. Additionally, in grades 1 to 3, we find a positive relationship between school CE 
concentration and student achievement gain (after controlling for other differences among students) 
regardless of which sample is used in the analysis. Findings for all other variables are quite different 
between the two samples, and at the same time are not subject to clear interpretations. 

In general, fewer variables prove to be useful in differentiating the successful' CE students from the 
'unsuccessful' ones than in discriminating the two groups of high-growth and low-growth students 
in the entire sample. This result is expected largely because the sample of CE students is con- 
siderably smaller. However, in every grade, both the canonical correlation and percent of correct 
classification are noticeably larger for the analyst that examines only CE students than for the 
general analysis that examines all students. The reader is reminded that slightly different grouping * 
procedures are used in the two analyses; but in either case, members of the 'high' grov th group 
achieve substantially greater gains than these of the low' growth group. Additionally, the amount of 
variation of the discriminating variables in the sample and the number of discriminators used could 
also influence these statistics. When the same set of discriminators is used (as in the case when all 28 
potential discriminators are used), we find the same differences in these statistics between the two 
samples. 
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Table 8-6 



Effective Discriminating Variables That Differentiate 'High' From 'Low' Growth and the 
Directions of Their Effects in the Analyses Using the Entire Sample and the 
Sample of CE Students, for Reading and Math by Gradet 



Effective Discriminating Variables 


Reading by Grade 


Math by Grade 


1 2 3 4 5 6 


1 2 3 4 5 6 


Regular Instruction 
Special Instruction 
Tutor/Independent Work 


+ +* +* +* 
-* - - -* 

+ + + + 


+ * +* +* +* + +* 

_ * _** +* 
+ +* +* + +* 


Staff/Student Ratio 

Support /Teaching Personnel Ratio 

Years of Teaching 

Highest Degree Earned 

Recent Inservice Training 

Belief in Schooling 

Attitude to School Programs 


— * - 

+ + + + + 
+ * -* 
+ * * -* +* 

+ * - * 


-* r** -* „ 
+ * + +* +* 

+ * +** 

+ * -* 

-r* + +* +* 


School's Minority Concentration 

School's Poverty Concentration 

School's CE Concentration 

School's Low-Achiever Concentration 

School's Central Resources 

Pa rent /Community Involvement 

District Control of Instruction 

Principal's Instructional Leadership 

Teacher's Involvement in Decisions 

Disturbance of Instruction 

District's Percent of Administrative Staff 


+* - +** 

+ + + +** +* +* 
_* -* - -** - -* 
+ * * +* * 
+ * 

+** -** 
.** 

+ * -* 
_ +* — ** 


-* +* -* 
+ * +** 
+ + +* * 
-* - -* -* - 

+ 

_** -** -* + * 

- -** 
- A -** -* 
-** +* - * - -* 
+* -* -* 


Effort in Planning and Evaluation 
Teacher's Use of Lesson Plans 
Frequency of reedback per Semester 
Weekly Homework Assigned 
Monthly Use of .Materials 
Individualization of Instruction 
Monthly Use of Audio-Visual Equipment 


+ ** + +** +* 
-* + 
-* +* +* 
+ * -* 
+ +* 

_* 


+ * * +* 

+ +* 
+ * + +* 
+* +* +* 
+** +** -* 
+ * -* +* 
- _ * * 


Classroom Achievement Level 
Class Size 


+ 


+ * +* 



+ The results of the analyses using the entire sample were extracted from Tables 7-3 and 7-4, and the results of the analyst 
for CE students only were extracted fro-n Tables 8-5 and 0-7, for reading and math, respectively. '+' and •-• indicate 
positive and negative, respectively, associations with 'high' growth. Pretest achievement quartile and CE status were ex- 



cluded from this tabulation. 

*S ^ only in the analyses for the entire sample. r OO w 

**skl\lC°nly in the analyses for CE stud^ts. 
^IMffiJjjisfcs indicate that the variable is selected in both analyses. 



In summary, the present analyses confirmed some of the earlier findings in Chapters 6 and 7. 
Among the educational variables, teacher experience is the most likely to contribute to the explana- 
tion of differences in achievement growth. In addition, concentration of CE students and concentra- 
tion of low-achieving students in the school are also frequently related to achievement growth. With 
regard to instructional services, amount of time spent working'with tutors or independently is 
positively related to achievement growth. However, no clear picture emerges as to what 
characteristics of the educational program are particularly effective in improving reading achieve- 
ment of CE students. There is little evidence that some educational methods promote the achieve- 
ment of CE students but not that of other students. This conclusion is in agreement with the lack of 
evidence for the interaction effects between the educational process and student CE status (see the 
previous section of this chapter). 

Results of the Analyses (or Math. Table 8-7 presents the summary statistics and discriminant func- 
tions for math. Inspection of the bottom two sections of this table reveals small reductions in the 
canonical correlations and the percentages of correct classification (ranging from 0.9 to 4.0 per- 
cent) as a result of the elimination of some of the 30 potential discriminators by the stepwise pro- 
cedure. Unlike in reading, the canonical correlation and percent of correct classification do not 
decrease sharply in the upper grades. 

Examining the discriminant functions, we find that Title I participation is a useful discriminator 
between the 'high' and low' growth groups in grades 1, 3, and 4. In these grades, Title I students 
are more likely to belong to the high-growth group than other CE students, attesting to the success 
of Title I programs. Instructional services in general are not important in explaining the differences 
between the two groups of CE students. 

Among other characteristics of the educational process, only School's CE Concentration shows 
significant discriminating power in more than two grades (in grades 1, 2, and 6). The importance of 
this variable in the distinction between high and low growth was also observed in reading at the first 
two grades. Additionally, in grades 1 and 2, more use of materials is associated with 'high' growth, 
while more frequent use of audio-visual equipment is related to 'lower' growth. Four other variables 
indicate negative relationships with math achievement growth: School's Low-Achiever Concentra- 
tion (grades 2 and 5), Parent/Community Involvement (grades 1 and 3), Principal's Instructional 
leadership (grades 2 and 6), and Disturbance of Instruction (grades 1 and 5). The remaining 
variables, if selected, contribute significantly to the distinction between groups in a single grade. 
The fact that these significant relationships are found in different grades without some regularity 
makes it difficult to decipher their implications. 

The second part of Table 8-6 presents a summary of the results from the discriminant analyses for 
math using the general sample of all students (T able 7-4 in Chapter 7) and those using the restricted 
sample of CE students only (Table 8-7). These summary data are examined in order to determine if 
there are any characteristics of educational programs that are specifically effective for differentiating 
math achievement growth among CE students. 

In general, the two sets of educational process variables selected to discriminate the two growth 
groups differ considerably between the analyses using the two different samples. More variables are 
found significant in the general sample than in the sample of CE students, again partially because of 
larger sample sizes. Out of a total of 66 significances observed in the two samples, 41 apply to the 
general sample but not to the sample of CE students, 13 apply to CE students but not the genera' 
sample, ar$ only 12 apply to both samples. 

Among the significant discriminators in the sample of CE students, the variables generally do not 
play a specifically important role in the differentiation between high and low achievement growth 
for the CE students alone. Nevertheless, in two rare cases, the variables appear to be effective for 
the discrimination only in the sample of CE students: in grades 1 and 3, Parent/Community Involve- 
ment tends to be related to low' growth, while in grades 1 and 2, monthly use of materials is 
favorably connected with 'high' growth. In these instances, the variables are not selected as useful 
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Table 8-7 



Stepwise Two-Group ('High' vs. 'Low' FalMo-Spring Growth) Discriminant Analyses for 
Examining the Effect of Instructional Services Received, and Characteristics of 
Educational Process on the Math Achievement Growth of CE Students* 



Standardized Discriminant 



lents (Beta) 



Discriminating Variables 


Grade 


1 


Grade 2 


Grade 


3 




Grade 


4 


Gt adc 


5 


Grade 


6 


Selected by the Stepwise 
















Discriminant Procedure 




Beta 




Ent 


Beta 


Entry 


Beta 


En 


Beta 


Entry 


Beta 




r er 


Ord Beta 
er 


Order 








Order 




Order 






























Pretest Achievement Quartilc 


I 


- .72 


1 - .93 


I 


_ 


.90 


1 


- .89 


1 


-.80 


1 


■1 .00 


Participation in Title I Programs 


10 


. 14 


NA 


4 




• 20 


3 


. 2 8 


NA 




NA 




Instructional Services Received 


























Regular^ Instruction 


NA 




NA 


NA 






NA 




5 


.28 


NA 




^Special ' Instruct ion 


NA 




NA 


5 




.15 


NA 




NA 




NA 




Tutor/ Independent Work 


4 


. 17 


NA 


NA 






NA 




4 


.37 


NA 




Characteristics of Educational Process 


























Suppor t /Teaching Personnel Ratio 


NA 




NA 


NA 






2 


.35 


NA 




NA 




Years or* Teaching 


NA 






NA 








. 19 


NA 




NA 




Recent Inservice Training 


NA 




NA 


NA 






NA 




9 


. 19 


NA 




Attitude to School Programs 


NA 




6 .20 


NA 






NA 




NA 




NA 




School' 3 Poverty Concentration 


NA 




NA 


NA 






NA 




8 


.35 


NA 




School '3 CE Concentration 


3 


.32 


3 .32 


NA 






NA 




NA 




2 


.33 


school 3 I.ow~ AchiGvcr Concentration 






4 - . 30 








NA 






- .61 


NA 




School's Central Resources 


8 


.22 


NA 


NA 






NA 




NA 




NA 




Parent/Community involvement 


9 


-.23 


NA 


3 




.20 


NA 




NA 




NA 




Principal's Instructional Leadership 


NA 




NA 


2 




.20 


NA 




NA 




3 


-.30 


Teacher's Involvement in Decisions 


NA 




7 - . 18 


NA 






NA 




NA 




NA 




Disturbance of Instruction 


2 


-.33 


NA 


NA 






NA 






-.29 


NA 




Effort in Curriculum Development 


6 


.24 


NA 


NA 






HA 




NA 




NA 




Teacher's Use of l>csson Plans 


NA 




NA 


NA 






NA 




S 


.19 


NA 




Frequency of Feedback per Semester 


NA 




NA 


NA 






NA 




7 


.24 


NA 




Monthly Use of Materials 


7 


.18 


5 22 


NA 






NA 




NA 




* NA 




Monthly Use of Audio-Visual Equipment 


5 


-.33 


2 - .29 


NA 






NA 




NA 




NA 




Statistics for the Discriminant Function 


























Mo tin Discriminant. Scoros 


N 


Mean 


N Mean 


N 




oan 


N 


Mean 


N 


Mean 


N 


Mean 


•High* Growth Group 


485 


.343 


371 .350 


329 




470 


308 


.390 


309 


.375 


339 


.255 


/ 'Low* Growth Group 


103 


- .801 


205 -.633 


2 30 




67^ 


240 


-.501 


185 


-.626 


180 


-.481 


Wilk's Lambda 


.704 


.773 


.*83 




.804 


.7S5 


.877 


Chi-Squar* Test Statistics** 


235 


.3 


14 3.2 


211 


.1 


118 


.4 


130.8 


67 


.6 


Canonical Correlation (Squared) 


.544 


.296) 


.471 (.222) 


.563 




317) 


.442 


(.195) 


.485 


(.235) 


.351 


.123) 


Portent of Correct Classification 


76 


8 


72.2 


75 


7 




70 


.6 


72 


.5 


69 .V 


When all 30 Potential Discriminators are used 


























Canonical Correction (Squared) 


.574 


.329) 


.517 (.267) 


.603 




364) 


.522 


(.272) 


.518 


( .268) 


.416 


(.1737 


Percent of Correct Classification 


78 


5 


76.0 


77.6 




74 


.6 


75 


.7 


69.9 



The 'High' and 'Low' growth groups created for this analysis comprise Math CE students whose Fall-to-Spring growth is at least one s.d. 

below respectively, the average for the non-CE students judged to have need for math CE but attending schools that do not provide 

.potential discriminators employed include pretest achievement status, participation in Title I programs, three kinds of instructional 
P Q I received, and 25 educational-process variables that were found to be effective in predicting posttest scores for at least one of the 
^JjAL^ ?. The selection criteria of the discriminators in the stepwise procedure are 4.0 for 'F-to-Enter* and 3.9 for 'F-to-Remove ' . 

'""Degree of freedom » number of discriminators selected) all chi -squares are significant at the .01 level . 



discriminators in the general sample. On the whole, we find few educational process variables that 
are particularly effective in improving the math achievement of CE students but not in the general 
sample. 

Despite the fewer discriminators used, both the canonical correlations and the percentages of cor- 
rect classification are substantially larger in the restricted sample of CE students than in the general 
sample.. This is a similar finding as in reading, and the reader may refer to the preceding section for 
some discussion of its implications. 

In summary, few of the educational variables considered prove to be systematically discriminating 
between math CE students who achieve gains higher than expected and those who achieve gains 
lower than expected. There is also little agreement between the results of the analyses using two dif- 
ferent samples, the sample of all students and that of CE students only. The variables, such as 
amount of regular instruction, tutor/independent work, years of teaching, teacher attitude to school 
programs, and school low-achiever concentration, that are associated with achievement growth in 
the general sample, fail to demonstrate the same discriminating power in the sample of CE students. 

Conclusions. The discriminant analysis using the 'high' and low' growth CE students did not pro- 
duce much new information regarding the characteristics of educational programs that are par- 
ticularly effective in improving achievement. There is no indication that any of the educational 
aspects we consider has a special relationship with the achievement of CE students that is different 
from its general relationship with achievement. 

SUMMARY AND CONCLUSIONS 

In an effort to further our understanding of the nature of the relationship between the characteristics 
of educational process and achievement, the interaction effects on achievement between the 
educational process and student characteristics are examined with linear models. We conclude 
from our analysis that the effects of the educational process do not systematically vary with student 
characteristics. In general, their relationships with student characteristics are weak and the implica- 
tions are ambiguous. Most of the interact^-' \ivolve characteristics of the school's existing condi- 
tions (e.g., concentrations of low-achieving students and minorities), which are not easily 
manipulate. Moreover, these interactions are observed mostly in isolated cases (i.e., in a single 
grade or subject area); the differences among grades or between reading and math are not clearly 
interpretable. However, we attempt to offer some possible explanations for each finding so as to 
benefit future research in the area. 

Additionally, the technique of discriminant analyses is applied to help us determine the 
characteristics of educational programs that may be related to the achievement differences between 
CE students who achieved gains higher than their comparable non-CE peers and those who 
achieved lower gains. The analysis, however, could not substantiate the belief that there are some 
educational aspects that are particularly effective »n promoting the achievement of CE students but 
not that of all elementary students. 

In conclusion, the analysis in this chapter does not substantially increase our understanding of how 
the educational process is related to achievement. We suspect that fruitful results can only be ex- 
pected when we have pertinent and penetrative data for the educational process. The distal 
measures obtained through questionnaire surVey -re unlikely to have direct relationships with 
achievement. For instance, we do not believe that the amount of homework assigned as reported 
by the teacher can affect student achievement unless he/she diligently works on it and the 
homework is appropriate and relevant to learning. We therefore suggest that future study concern- 
ing .the effects of educational process emphasize frequent classroom observations and in-depth 
teacher interviews in order to improve our chances of getting valid and proximal measures of 
educational practices and student learning behaviors. In addition, home interview is necessary to 
obtain accurate information on student background, home environment, and extra-curricular 
activities (e.g., approach to homework). Until then, we are not optimistic that our understanding of 
the achievement process would be improved. 
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Data items and formats for the Report 10 General Analysis File (GAF) are 
summarized here for analysis references- The 2-4 character prefix for the 
data item name indicates the instrument from which the data item was obtained, 
with exceptions of the instructional service items and RMC's resource cost 
variables- Each of the data it.ms obtained from RMC's resource cost tape is 
given a name beginning with a character 'C. Data items showing yearly hours 
of instructional services attended by the student are givtn names beginning 
with a character 1 V . Data items that were obtained from aggregate statistics 
have names ending with a character 'S'. 



The 'best-level' of CTBS refers to the test level that was selected for admin- 
istrations in later years and recommended for use in analysis. It varies 
with schools for a given grade. DBRS is used as an acronym for De-Biased Paw 
Score, while PRS is used for Publisher 1 s (non-debiased) Raw Score. 'Total 1 
refers 'to the combined reading and math tests. The prefixes that indicate the 
source instruments are: 



CTBS 


Comprehensive Tests of Basic Skills 


SAM 


Student Affective Measures 


PAS 


Practical Achievement Scale 


SPAPM 


Student Participation and Attendance Record, Reading and Math 


SBC 


Student Background Checklist 


CER 


Compensatory Education Roster 


PQ 


Principal Questionnaire, Sections A and B 


DCH 


District Characteristics Questionnaire 


DEX 


District Expenditure Questionnaire 


DQ 


District Questionnaires (DCH and DEX) 


TQA 


Teacher Questionnaire, Section A 


TQB 


Teacher Questionnaire, Section B (Reading) 


TQC 


Teacher Questionnaire, Section C (Math) 


Si\S 


Summer Activity Slipsheet 



Content and Format of the Data File Employed in Report 10 



Description 



Data Item 



Position in 
the File 



Name 



School Number (Fall) 
Student Number (Fall) 
School Number (Spring) 
Student Number (Spring) 
Grade © 



SCHOOLF 
STUDNOF 
SCHOOLS 
STUDNOS 
GRADE 



1 

5 
11' 
15 
21 



4 

10 
14 

20 



From STUDA1 . CTBS12 . RESCORES FILE 



Fall Below-level Indicator 
Fall At-level Indicator 
Fall Best-level Indicator 



FBEL0W1 
FATIND1 
FBESTI1 



22 
23 
24 
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Description, 



Data Item 
Name 



Position in 
the File 



Fall Reading Be low- level DBRS 
Fall Reading At- level DBRS 
Fall Math Below- level PRS 
Fall Math At-level PRS 
Fall Total Below- level DBRS 
Fall TStal At-level *DBRS 



CTBS101 
CTBS102 
CTBS103 
CTBS104 
CTBS105 
CT3S 106 



Fall Reading Best- level DBRS 
Fall Math Best- level PRS 
Fall Total Best- level DBRS 

CTBS119 Converted to Percentile (Fall Norms) 
CTBS120 Converted to Percentile (Fall Norms) 
*CTBS121 Converted to Percentile (Fall Norms) 

CTBS119 Converted to VSS 
CTBS120 Converted to VSS 
CTBS121 Converted to VSS 

Spring Below- level Indicator 
Spring At-level Indicator 
Spring Best-level Indicator 

Spring Reading Below-level DBRS 
Spring Reading At-level DBRS 
Spring Math Be low- level PRS 
Spring Math At-level PRS 
Spring Total Be low- level DBRS f 
Spring Total At-level DBRS 



CTBS128 
CTBS129 
CTBS130 
CTBS131 
CTBS132 
CTBS133 



Converted 
Converted 
Converted 
Converted 
Converted 
Converted 



to Percentile 
to Percentile 
to Percentile 
to Percentile 
to Percentile 
to Percentile 



(Spring Norms) 
(Spring Norms) 
(Spring Norms) 
(Spring Norms) 
(Spring Norms) 
(Spring Norms) 



CTBS119 
CTBS120 
CTBS121 

CTBS122 
CTBS123 
CTBS124 

CTBS125 
CTBS126 
CTBS127 

SBELOWl 
SATINDl 
SBESTIl 

CTBS128 
CTBS129 
CTBS130 
CTBS131 
CTRS132 
CTBS133 

CTBS134 
CTBS135 
CTBS136 
CTBS137 
CTBS138 
CTBS139 



-25-27 
28-30 
31-33 
34-36 
37-39 
40-42 



CTBS101 


Converted 


to 


Percentile 


(Fall Norms) 


CTBS107 


43-45 


CTBS102 


Converted 


to 


Per sentile 


(Fall Norms) 


CTBS108 


46-48 


CTB%103 


Converted 


to 


Percentile 


(Fall Norms) 


CTBS109 


49-51 


CTBS104 


Converted 


to 


Percentile 


(Fall Norms) 


CTBS110 


52-54 


CTBS105 


Converted 


to 


Percentile 


(Fall Norms) 


CTBSJ 11 


55-57 


CTBS106 


Converted 


to 


Percentile 


(Fall Norms) 


CTBS112 


58-60 


CTBS101 


Converted 


to 


VSS (Vertical Scale Score) 


CTBS113 


61-63 


CTBSJ02 


Converted 


to 


VSS 




CTBS114 


64-66 


CTBS103 


Converted 


to 


VSS 




CTBS115 


67-69 


CTBS104 


Converted 


to 


VSS 


Co 


CTBS116 


70-72 


CTBS105 


Converted 


to 


VSS 




CTBS117 


73-75 


CTBS106 


Converted 


to 


VSS 




CTBS118 


76-78 



79-81 
82-84 
85-87 

88-90 
91-93 
94-96 

97-99 
100-102 
103-105 

106* 
107 
10S 

109-111 
112-114 
115-117 
118-120 
121-123 
124-126 

127-129 
130-132 
133-135 
136-138 
139-141 
142-144 



( 
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Description 



Data Item 
Name 



CTBS128 Converted to VSS (Vertical Scale Score) CTBS140 

CTBS129 Converted to VSS CTES141 

CTBS130 Converted to VSS CTBS142 

CT3S131 Converted to VSS CTBS143 

CTBS132 Converted to VSS CTBS144 

CTBS133 Converted to VSS CTBS145 

Spring Reading Best-level DBRS - CTBS146 

Spring Math Best- level PRS CTBS147 

Spring Total Best-level DBRS CTBS148 

\ 

C£BS146 Converted to Percentile (Spring Norms) CTBS149 

CTBS147 Converted to Percentile (Spring Norms) CTBS150 

CTBS148 Converted to Percentile (Spring Norms) CTBS151 

CTBS146 Converted to VSS CTBS152 

CTBS147 Converted ,to VSS . CTBS153 

CTBS148 Converted to VSS „ CTBS154 



Position in 
the File 

145-147 
148-150 
151-153 
154-156 
157-159 
160-162 

163-165 
166-168 
169-171 

172-174 
175-177 
178-180 

181-183 
184-186 
187-189 



From STUDA1.SAMPAS1. SCORES and STUDA 1 * SAMPAS 2 * SCORES Files 



Fall Affective Total 
Fall Attitude to Reading 
Fall Attitude to Math 
Fall Attitude to School 

Fall Practical Achievement Score 

Spring Affective Total 
Spring Attitude to,Readihg 
Spring Attitude to Math 
Spring Attitude to School 

Spring Practical Achievement Score 



SAM001A 
SAM002A 
SAM003A 
SAM004A 

PAS001A 

SAM001B 
SAM002B 
SAM003B 
SAM004B 

PAS001B 



190-192 
193-195 
196-198 
199-201 

202--M 

205-20/ 
208-210 
211-213 
214-216 

217-219 



Fr6m STUDA 1 . SPARM14 . SUMS File 

Weeks Present in 1976-77 School Year 
Average Hours of Reading Per Week 



Total 
Total 
Hours 
Hours 
Hours 
Hours 
Hours 
Hours 
Hours 
Hours 
Hours 
Hours 



Hours of Reading Offered per Year 
Hours of Reading Attended per Year 
of Reading per Year, Teacher, 21+ Class 



of Reading Per Year, 
of Reading per Year, 
of Reading per Year, 
of Reading per Year, 
of Reading per Year, 
of Reading per Year, 
of Reading per Year, 
of Reading per Year, 
of Reading per Year, 



Teacher, 14-20 
Teacher . 7-13 
Teacher, 1-6 
Special Teacher, 7+ 
Special Teacher, 1-6 
Aide, 1-10 
Tutor 

Independent , pgm . 
Independent, Non-pgm. 



ATTEND 
WEKREAD 

READOFF 

YEAREAD 

YREADA 

YREADB 

YREADC 

YREADD 

YREADE 

YREADF 

YREADG 

YREADH 

YREADI 

YREADJ 



220-222 (F3.1) 
223-227 (F5.1) 

228-232 
233-237 
238-242 
243-247 
248-252 
253-257 
258-262 
263-267 
268-272 
273-277 
278-282 
283-287 



JC 



9C 



S3 
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Description 



Data Item 
Name 



Position in 
the File 



Average Hours ot Math per Week 
Total Hours of Math Offered per Year 

Total Hours of Math Attended per Year 

Hours of Math per Year, Teacher, 21+ Class 

Hours of Math per Year, Teacher, 14-20 

Hours of Math per Year, Teacher, 7-13 

Hours of Math per Year, Teacher, 1-6 

Hours of Math per Year, Special Teacher, 7+ 

Hours of Math per Year, Special Teacher, 1-6 

Hours of Math per Year, Aide, 1-10 

Hours of Math per Year, Tutor 

Hours of Math per Year, Independent, pgm^ > ^ 

Hours of Math per Year, Independent, non-pgm. 

From STUDA1 • SAS1 » SCORES File 

Stffomer Reading Experience 
Summer Math Experience 

From STUDA1.SBC1. SCORES File 
Sex 

Race/Ethnicity 

Free or Reduced-Price Lunch 

CE Reading, 1975-76 

CE Reading, 1976-77 

CE Math, 1975-76 

CE Math, 1976-77 

Guidance and Counseling, 1976-77 

Health and Nutrition, 1976-77 

Teacher Judgment of CE Need 

Class Reading Level 

Class Math Level 

Mother's Education 

Father's Education 

Other Language Spoken in Home 

Early Childhood Experience 

Total Parental Involvement 

From STUDA1.CER1. SCORES File 

Sum of CER Reading 
Sum of CER Math 

Reading CE Selection Status, 1976-77 

Math CE selection Status, 1976-77 

Student's Total CE Reading Expenditure (Prorated) 

Student's Total CE Math Expenditure (Prorated) 



WEKMATH 
MATHOFF 

YEARMATH 

YRMATHA 

YRMATHB 

YfcMATHC 

YRMATHD 

YRMATHE 

YRMATHF 

YRMATHG 

YRMATHH 

YRMATHI 

YRMATHJ 



SAS001 
S AS 00 2 



SBC004 

SBC005 

SBC007 

SBC008A 

SBC008B 

SBC003C 

SBC008D 

SBC008F 

SBC008H 

5BC011 

SBC012 

SBC013 

SBC015A 

SBC015B 

SBC016 

SBC020 

SBC021 



CER002 
CERJW3 
CER014 
CER015 
CER027 
CER028 



288-292 (P5.1) 

293-297 (F5.1) 

298-302 (F5.1) 

303-307 (F5.1) 

308-312 (F5.1/ 

313-317 (F5.1) 

318-322 (F5.1) 

3*>3-327 (F5.1) 

328-332 (F5.1) 

333-337 (F5.1) 

338-342 (Ip5.1) 

343-347 (F5.1) 

348-352 (F5.1) 



353-355 
356-358 



359 
360 
301 
362 
363 
364 
365 
366 
367 
368 
369 
370 
371 
372 
373 
374 

375-376 



377 
378 
379 
380 

381-383 (F3.0) 
384-386 (F3.0) 
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Description 



Data Item 
Name 



Position in 
the File 



From Aggregate statistics for SBC, CER, CTBS Variable s 

Percent Minority Enrollment in School (Non-White) SBC005S 
Percent Free-Lunch Participants in School SBC007S 
Percent other Language Spoken in Home - SBC016S 

Percent Reading CE Students in School 
Percent Math CE Students in School 

Percent Reading Belov-34%ile (Fall, Best-level) 
Percent Math Below-34%ile (Fall, Best-level) 



CER002S 
CER003S 

RLACHS 
MLACHS 



From 1975-?76 Principal Survey (File SCHLS0.PSQ1.EDIT) 



Geographic Region 
Size Code cf LEA 
Poverty Code of LEA 

School Urbanism (Recoded into 7 Categories) 

*Frc>in RMC.RESC0ST.STUDAl.TR7.R£SPGM. REAr> Files 
MATH 



Total Reading Program Cost 



Reading Pgm. 
Reading Pgm. 
Readinc Pgm. 
Re a dim- Pgm. 
Reading Pgm. 
Reading Pcnw 
Reading Pgm. 
'Reading Pgm. 
Reading Pgm. 
Reading Pgm. 



Component 
Component 
Component 
Component 
Component 
Component 
Component 
Component 
Component 
Component 



Cost, 
post, 
Cost, 
Cost, 
Cost, 
Cost, 
Cost, 
Cost, 
Cost, 
Cost, 



Teacher, 21+ Class 
^Teacher, 14-20 
Teacher, 7-13 
Teacher, 1-6 
Special Teacher, 
Special Teacher, 
Aide, 1-10 
Tutor 

Independent, Pgm 
Indep* Non-pgm. 



7+ 
l-€ 



Totai Math Program Cost 
Math Pgm. Component Cost, 
Math Pgaw Component Cost, 
Math Pgm. Component Cost, 
Math Pgm* Component Cost, 
Math Pgm. Component Cost, 
Math Pgm. Component Cost, 
Math Pgnw Component Cost, 
Math Pgm, Component Cost, 
Math Pgm. Component Cost, 
Ma-ii Pgm. Component Cost, 



Teacher, 21+ Class 
Teacher, 14-20 
Teacher, 7-13 
Teacher, 1-6 * 
Special Teacher, 7+ 
Special Teacher, 1-6 
Aide, 1-10 
Tutor 

Independent, Pgm. 
Independent, Non-pgm* 



REGION 

LEASIZE 

LEAPOV 

LOCATION 

f 



CREAD 

C READ A 

CREADB 

CREADC 

CREADD 

CREADE 

CREADF 

CREADG 

CREADH 

CREADI 

CREAD J 

CMATH 

CKATHA 

CMATH B 

CMATHC 

CMATHD 

CMATHE 

CMATHF 

CMATHG 

CMATHH 

CMATHI 

CMATHJ 



387-389 (F3,0) 

390-392 (F3,0) 

393-395 (F3.0) 

396-398 (F3,0) 

399-401 (F3.0) 

402-404 (F3.0) 

405-407 (F3.0) 



408 
409 
410 
411 



412-418 
419-425 
426-432 
433-439 
440-446 
447-453 
454-460 
461-467 
468-474 
475-481 
482-488 

489-495 
496-502 
503-509 
510-516 
517-523 
524-530 
531-537 
538-544 
545-551 
552-558 
559-565 



(F7.2;> 
(F7.2) 
(F7.2) 
(F7.2) 
(F7.2) 
(F7,2) 
(F7,2) 
(F7,2) 
(F7*2) 
(F7.2) 
(F7,2) 

(F7.2) 
(F7.2) 
(F7.2) 
(F7.2) 
(F7.2) 
(F7.2) 
(F7,2) 
(F7.2) 
(F7.2) 
(F7.2) 
(F7.2) 



From SCHLA1.PQ1. SCORES File 

School Facilities (Categorical, Recode Required) 
Days in School Session, 1976-77 (Categorical) 
School Grade Span (Categorical) 
Staff/Student Ratio 
Support/Teaching Personnel Ratio 
Student Mobility Rate 

Parent/Community Involvement (Composite) 



PQBMJ1 

PQB003 

PQ036 

PQ037 

PQ038 

PQ039 

PQ041 



566 
567 
568 

569-570 (F2.2) 

571-574 (F4.2) 

575-577 (F3.1) 

578-579 (F2,0) 



9 
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Description 



iata -Item 
Name 



Position in 
the File 



District Control of Instruction PQ043 

Principal's instructional Leadership PQ044 

Teacher Involvement in Decision Making PQ045 

Disturbance of instruction PQ050 

Ability grouping PQ051 

Fr om SCHTA1.DQ1. SCORES* File 

1 j 

District Has. No Testing Pgm. or No Results Report DCHA004A 

School ADA (Size indicator) DEXBJ5J51A 

School's Current Per-pupil Expenditure * DEXB00}C 

District's Percent of Administrative Staff DQ001 

From TCHBA1 .TQAl . SCORES File 

Reading Teachers' 

Years of Teaching • TQA001R 

Highest pegree Earned TQA004R 
Hours of fading Inservice Training, Last 3 Yrs. TQA007R 

Importance of School Causes for Achievement TQA012R 

Positive Attitude to School Programs (TQA024K) TQA024R 

Experience and Training (Composite) TQA031R 

Math Teachers' 

Years of Teaching , " — * 

Highest Degree Earned v 
Hours of Math giservice Training, Last 3 Yrs. 
Importance of School Causes for Achievement 
Positive Attitude to School 'Programs 
Experience and Training (Composite) 

From TCHRA1.TQB1. SCORES File (Reading v Program) 

Size of Reading Class TQB007 

Hours per Year for Reading Curriculum Development TQB008 

Hours per Yr. for R. Needs Assess*, Plan," Eval. TQB009 

Use of Lesson. Plan in Reading Instruction TQB010 

Freq. per Semester of Total* Reading Feedback TQB015P 

Hours per Week of Reading Homework assigned TQB021 

Freq. per Month of Use of Reading Materials TQB029 

Individualized Approach in Reading Instruction TQB034 
Freq. per Month of Audio-Visual Exposure in Reading TQB0356 



\580-581 
582-583 
584-585 
586-588 
589-590 



(F2.0) 
(fr2.0) 
(F2.0) 
(F3.0) 
(F2.0) 



591 

592-595 -(F4.0) 
596-599* (F4.0) 
600-601 (F2.0T 



602-603 
604 

605-606 
607 

608-609 
610-611 



(F2.0) 
(F1.0) 
(F2.0) 
(F1.0) 
(F2.0) 
(F2 f 0) 



TQA001M/. • 


/614 


•613 


(F2.0) 


TQA004M 




% (F1.0) 


TQA007M 


615-616 


(F2.0) 


TQA012M 


617 




(F1.0) 


TQA024M 


N 618- 
l\620- 


•619 


(F2.0) 


TQA031M 


•621 


(F2.0) 



622-623 
624-625 
626-627 
628 

629-631 
632-633 
634-636 
637-638 
639-641 



(F2.0) 

(F2.0) 

(F2.0)' 

(F1.0) 

(F3.6) 

(F2.1) 

(F3.0) 

(F2.0) 

(F3.0) 



9 

ERLC 



Is 



T 



Description 



Data -Item 
Name 



Position in 
the File 



From TCHKA1 . TQC1 . SCORES File (Math Program) . * 

• Size Of Math Class /' ' % TQC006 " 642^643 

Hours per Year for Math Curriculum Development TQC007 , 644*645 

Hours per Yr. for Math Need Assess,, Plan, Eval. TQC008 ' 646-647 

Use of Lesson Plan in Math 'Instruction TQC009 648 

Freq. per Semester- of Total Math Feedback TQC014D " -649-651 

Hours per Week of Math Homework Assigned TQC019 - 652-653 

Freq. per Month of Use of Math Instruc. Materials TQC026 654-656 

Individualized Approach in Math Instruction TQC032 657-658 

Freq. per Month of Audio-Visual Exposure in Math TQC0334 659-661 



(F2.0) 
(F2.0) 
(FS.O) , 
(P1.0) 
(F3.0) 

*F2.1) 
(F3.0) 
(FZ.O) 
(F3.0) 



J. 



1 



2S7 > 



./ 

/ 



9 

ERLC 



\ 



256 



APPENDIX A 2 



Tables of the Rates of Missing CTBS 
Scores by Student Characteristics 



/ 

i 



» i 

2S3 

ERJC 



Table A2-1 

Percentages of Students With and Without CTBS Reading Scores for Fall and Spring by School Sample and Racc/Ethtricity 



CTBS Reading 

Scores 

Available 



Students in Entire Sample 
Whlte HerTti h e Bla <* 0ther Total 



Students in Representative Sample 
White h^""^ Black Other Total 



Students in Comparison Satrple 
Whlte Ho P rTta, h e BUck 0ther T °"' 



Students m Nominated Sample 



Samp 



Hhlte £X BUek other Total 



Grade 1 

Fall & Spring 
Fall Only 
'Spring OAly 
Neither Time 

** 

Grade 2 



83.8 
8.8 
7.4 
0.1 
12.853 



74.6 
12.9 
12.3 
0.2 



82.2 
9.4 
8.3 
0.2 



81.4 
9.0 
9.4 
0.2 



82.5 
9.3 
8.1 
0.1 



84.3 73.2 



8.6 
7.1 
0.1 



1,698 5,316 542 20,409 



14.2 
12.4 
0.3 



82.1 78.4 
10.9 

n.6 
o.o 



9.6 
8.2 
0.0 



Fall & Spring 


85.7 


77.2 


82.1 


84.4 


84.0 


86.5 


76.8 


Fall Only 


7.7 


13.1 


9.0 


7.2 


8.4 


7.2 


13.7 


Spring Only 


6.6 


9.3 


8.8 


8.4 


7.5 


6.3 


9.1 


Neither Time 


0.0 


0.3 


0.1 


0.0 


0.1 


0.0 


0.4 


N* 


11 660 


1 520 


4 704 


475 


18 359' 


9 169 


1 087 


Grade 3 
















Fall & Spring 


86.5 


77.5 


84.1 


82.2 


8s:o 


87.0 


76.6 


Fall Only 


6.9 


12.7 


8.3 


6.3 


7.8 


6.5 


13.8 


o J 1 

Spring Only 


6.5 


9.3 


7.5 


11.0 


7.1 


6.4 


9.3 


Neither Time 


0.1 


0.4 


0.1 


0.0 


0.1 


0.1 


0.3 


N * 


11, 272 


1 585 


4 726 


444 


18 027 


9 029 


1 117 


Grade 4 














* 


Fall & Spring 


87.8 


78.8 


85.4 


82.0 


£6.3 


88.4 


77.2 


F^ll Only 


6.6 


11.7 


7.9 


9.3 


7.4 


6.2 


12.8 


Spring Only 


5.5 


9.2 


6.5 


8.7 


6.2 


$.3 


9.8 


Neither Time 


0.1 


0.2 


0.1 


0.0 


0.1 


0.1 


0.3 


N * 


11,379 


1,515 


4,412 


461 


17,767 


8,794 


1,073 


Grade 5 
















Fall £ Spring 


88.7 


80.8 


88.1 


85.9 


87.7 


89.2 


78.0 


Fall Only 


6.2 


10.2 


6.8 


7.1 


6.7 


5.9 


11.4 


Spring Only 


5.1 


8.6 


5.0 


6.9 


,5.4 


4.8 


10.0 


Neither Time 


0.1 


0.4 


0.1 


0.0 


P-l- 


0.0 


0.6 


N • 


11,546 


1,689 


4,636 


518 


18,389 


8,968 


1,029 


Grade 6 
















Fall Spring 


90.1 


85.3 


89.7 


90.5 


89.6 


90.8 


84.3 


Fall Only 


5.6 


8.8 


5.5 


5.6 


5.9 


5.3 


9.6 


Spring Only 


4.4 


5.4 


4.7 


3.8 


4.5 


3.8 


5.5 


Neither, Time 


0.0 


0.5 


0.1 


0.2 


0.1 


0.0 


0.7 


N* 


14,209 


1,814 


4,236 


556 


20,815 


11,398 


1,054 



81.1 83.7 



9.8 

9.0 
0.0 



6.9 
9.3 
0.0 



84.5 
8.2 
7.2 
0.1 



84.8 
5.3 
9.8 
0.0 



83.9 
9 3 
6.7 
0.0 



80.4 
9.2 

10.3 
0.0 



8/\ 3 88.1 
6.9 
5.0 
o.o 



7.1 
5.5 
0.1 



2,230 



89.8 
5.3 
4.9 
0.0 



303 



89.1 
6.8 
3.8 
0.3 



82.8 
9.3 
7.8 
0.1 



10,186 1,140 2,609 329 14,264 



84.7 
8.2 
7.1 
0.0 



2,175 289 12,720 



85.6 
7.4 
6.9 
0.1 



2,207 24-1 12,597 



86.5 
7.4 
6.0 
0.1 



2,143 271 12,281 



87.9 
6.6 
5.3 
0.1 

12,530 



90.2 
5.7 
4.1 
0.1 



1,963 338 14,753 



80.7 73.0 



10.9 
8.3 
0.1 

1,115 



82.6 
9.0 
8.4 
0.0 

1,014 



9.2 
7.6 
0.0 

895 



85.6 
8.5 
5.9 
0.0 

930 



86.7 
7.8 
5.5 
0.0 

949 



07.8 , 
5.8 
6.3 
0.0 

855 



11.6 
15.3 
0.0 

189 



76.3 
7-2 

16. *5 
0.0 

139 



8.8 
14.3 
0.0 

147 



77.7 
8.6 

13.7 
0.0 

139 



84.1 
9.4 
6.5 
0.0 

138 



85.7 
7.1 
7.1 
0.0 

56 



80.3 75.9 



8.5 
11.2 
0.0 

813 



80.2 
6.8 

12.8 
0.1 

794 



7.6 
11.7 
0.0 

778 



83.8 
6.8 
9.3 
0.1 

820 



90.1 
5.1 
4.7 
0.1 

684 



90. .J 
5 I 
«. S 
0.0 
592 



17.2 
6.9 
0.0 



88.0 
4.0 
8.0 
0.0 



83.2 76.9 80.7 60.9 



17.4 
21.7 
0.0 

23 



75.0 
18.8 
6.3 
0.0 



32 



80.8 
11.5 
7.7 
0.0 

26 



90 
10. 



0.0 

20 



->9. 8 
10.1 
10.0 
0.0 



29 2,146 



81.3 
7.9 

10.8 
0.1 



25 1 ,972 



81.4 
8.6 

10.0 
0.0 

1,843 



84.1 
8.0 
7.9 
0.1 
1,921 



87.7 
7.0 
5.3 
0.1 

1,797 



82.8 78.8 83.0 87.9 82.8 



8.7 
8.4 
0.1 

1,434 



82.6 
9.8 
7.6 
0.0 



9.4 
11.5 
0.3 



9.4 
7.z 
0.4 



339 1,762 



82.9 
9.7 
7.1 
0.4 



84.8 
8.8 
6.2 
0.2 



4.4 
7.1 
0.5 

182 



84.7 
8.3 
7.0 
0.0 



1,364 269 1,603 



157 3, 



85.2 80.0 



8.4 
6.4 
0.1 

1,240 



83.2 
9.0 
7.8 
0.1 
1,251 



84.5 
7.7 
7.6 
0.1 

970 



11.1 
7.5 
1.3 



85.0 83.0 84.5 

8.8 7.6 8.8 

9.4 6.5 

0.0 0.2 



6.1 
0.1 



305 1,622 



83.7 
10.5 
5.8 
0.0 



88.3 
6.4 
5.1 
0.2 



257 1,253 



171 



86.5 
7.7 
5.8 
0.0 



83.8 
10.0 
6.2 
O.C 



88.0 
7.1 
4.8 
0.2 



260 1,270 



84.9 8 

5.0 
10.1 

0.0 

159 2, 



88.8 


85.3 


86. 8 


8?. 3 


<„4.8 


88.2 


5.6 


7.8 


10.4 


5.8 


1.3 


6.5 


5.6 


6.9 


2.8 


4.6 


3.9 


5.2 


0.0 


0.0 


0.0 


0.3 


0.0 


0.1 


1,523 


769 


144 


1,192 


155 


2,?60 



Q I number of students m the Feeder f Schools have not been tabulated here. 
Y^r% f /^>"id to- that for the entire sample. 1 

ML 



Thus, the N's for the Representative,, 

< 2SJ 



Comparison, and Nominated Schools 



CTBS Math 

Scores 

Available 



Table A2-2 j 

Percentages of students With and Without CTBS Math Scores for Fall and Sgr\n£by s'chool Sample and Race/Ethnicity 



Students in Entire Sample » 
White He^i n tag h e 81 *<* <* her Total 



Students in Representative Sample 



Other Total 




Students in Nominated Sample 
WhltC H S e^i n tag h e Black 0ther 



Grade 1 






















Fall & Spring 


83.7 


73.9 


82.0 


81.2 


82.4 


84.2 


72.3 


81.9 


77.8 


82.7 


Pall Antu 


8.8 


13.3 


9. 4 


9 . 4 


9 . 4 


8. 6 


14.8 


9.3 


11.2 


9.3 


Spring Only 


7.4 


12.4 


8.2 


9.4 


8.1 


7.2 


12.6 


8.3 


10.9 


7.9 


Neither Time 


0.1 


0.4 


0.4 


0.0 


0. 2 


0.1 


0. 3 


.'0.5 


0.0 


0.2 




1 2 , 853 


1 698 


5 316 


542 


20, 409 


10,186 


1,140 


2,609 


329 


14,264 


Grade 2 












c ' 










Fall & Spring 


85.6 


77.0 


81.8 


84.0 


83.9 


86.4 


76.5, 


80.9 


83.4 


84.6 


Fall Only 


7.7 


13.2 


9.0 


7 . 8 


8. 5 


7 . 2 


13. 9 


9.7 


7.6 


8.2 


Spring Only 


6.7 


9.3 


8.9 


8.2 


7.5 


6.3 


9.1 


9.0 


9.0 


7.1 


neicner i ice 


0. 1 


0 . 4 


0.3 


0.0 


0. 2 


0.1 


0.5 


0.4 


0.0 


0.2 


N* 


1 1 , 660 


1 , 520 


4 704 




18 , 359 


9,169 


1,087 


2,175 


289 


12,7 20 


Grade 3 






















Fall & Spring 


86 . 4 


77 . 7, 


84.0 


81. 5 


84.9 


• 86.9 


76.8 


84.4 


83.6 


85.5 


Fall Only 


7.0 


12.5 


8.4 


7.4 


7 . 9 


6 . 6 


13.5 


v 8.3 


6.6 


7 . 5 


Spring Only 


6.5 


9.8 


7.3 


10.6 


7.1 


6.4 


9.6 


7.1 


9.4 


6.9 


Neither Time 


0. 1 




0 . 3 


0. 5 


0. 1 


0.1 


0. 1 


0.2 


, 0.4 


0,1 


N* 


11 , 272 


1 585 


4 726 




18 ,027 


9,029 


1,117 


2,207 


<^44 


12,597 


Grade 4 






















Fall & Spring 


87. 7 


78.6 


85.0 


82.0 


86.1 


88.-" 


76.9 


83^0 


80.4 


86.3 




6.6 


12.2 


8. 2 


9. 3 


7 . 5 


6. 1 


13.4 


9.8 




7.5 


Spring Only 


5.6 


8.8 


6.5 


8.7 


6.2 


5.3 


9.5 


6.6 


10.3 


6.0 


Neither Time 


0.1 


0.3 


0. 3 


0.0 


0.2 


0.1 


0.2 


0.5 


0.0 


0.2 




1 1 379 


1,515 


4,412 


461 


17 ,767 


8,794 


1,073 


2,143 


271 


12,281 


Grade 5 






















Fall & Spring 


88.6 


80. 5 


87.9 


85.9 


87.6 


89.1 


77.8 


87.0 


88.1 


87.8 


Fall Only 


6.2 


10.8 


6.9 


6. 9 




6 . 0 


12.1 


7 . 3 


6.6 


6.7 


Spring Only 


5.i . 


8.2 


5.1 


7.1 


5.4 


4.8 


9.4 


5.7 


5.3 


5.3 


Neither Time 


0. 1 


0 . 5 




0 . 0 


0 . 1 


0. 1 


0.7 


0. 1 


0.0 


0.1 


N* * 


11,546 


1^689 


4,636 


518 


18,389 


8,968 


1,029 


2,230 


303 


12,530 


Grade 6 






















^Fall & Spring 


89.9 


84.9 


89.5 


90.8 


89.4 


90.7 


84.0 


89. f> 


89.6 


90.0 


~Fall Only 


5.6 


9.0 


5.7 


5.6 


5.9 


5.4 


9.7 


5.6 


6.8 


5.8 


Spring Only 


4.4 


5.9 


4.7 


X.6 


4.5 


3.9 


6.2 


4.8 


3.6 


4.1 


Neither Time 


0.1 


0.2 


0.1 


0.0 


0. 1 


<. 0.1 


0. 2 


0.0 


0.0 


0.1 


N* 
• 


14,209 


1,814 


4,236 


556 


20,815 


11,398 


1,0$4 


1,963 


338 


14,753 



.80.7 72.5 

10.8 12.2 

8.4 14.8 

0.1 0.5 

1,115 189 



82.5 
8.7 
8.8 
0.0' 

1,014 



53.1 
9.3 
7.5 
0.1 

895 



75.5 
7.2 

17.3 
0.0 

139 



14.3 

0.0 



85.4 77.7 

8.4 8.6 

6.0 12.2 

0.2 1.4 

930 139 



87.0 
7 3 
5.3 
0.4 



83.3 
10.9 
5.8 
0.0 



949 138 



87.5 
6.2 
6.3 
0.0 

855 



83.9 
7.1 
8.9 
0.0 

56 



79.7 
9.5 

10.7 
0.1 

813 



80.2 
6.7 

12.8 
0.3 

794 



•81.6 
7.1 

11.3 
0.0 

778 



83.7 
7.3 
9.0 
0.0 

020 



91.1 
4.5 
4.2 
0.1 

604 



89.7 
5.6 
4.6 
0.2 

592 



75.9 
17.2 
6.9 
0.0 

- 29 



84.0 
8.0 
8.0 
0.0 



25 



60.9 
17.4 
21.7 
0.0 

23 



75.0 
18.8 
6.3 
0.0 

32 



80.8 
11.5 
7.7 
0.0 

26 



90.0 
10.0 
0.0 
0.0 

20* 



79.5 
10.5 
9.8 

-o.i 

2,146 



81.1 
7.8 

11 .0 
0.1 

1,972 



81.7 
8.4 
9.8 
0.1 

1,843 



83.9 
8.1 
7.8 
0.2 

1,921 



88.2 
6.6 
5.0 
0.3 

1,797 



88.2 
6.0 
5.6 
0.1 

1,523 



The small numbor of students in the Feeder Schools have not bcon tabulated here, 
do -not add to tltat for the entire sample. 



82.4 
9.0 
8.4 
0.2 

1,4 34 



82.4 
9.9 
7.6 
0.1 

1,364 



8S.2 
8.3 
6.5 
0.0 

1,240 



83.1 
9.2 
7/> 
0.1 

1,251 



84.5 
7.9 
7.4 
0.1 

970 



85.0 
7.8 
7.0 
0.1 

769 



78.8 
8.8 

11.5 
0.9 

339 



83.3 
9.7 
6.7 
0.4 

269 



80.0 
11.1 
8.9 
0.0 

305 



83.7 
10.5 
5.4 
0.4 

257 



83.5 
10.0 
6.5 
0.0 

260 



66.8 
10.4 
2.8 
0.0 
144 



83.0 
9.5 
7.2 
0. 3 



88.5 
4.9 
6.6 
0.0 



84.2 
9.1 
6.4 
0. 3 



84.7 
8.3 
7.0 
0.0 



84.5 
9,1 
6.0 
0.4 



83.0 
7.6 
9.4 
0.0 



88.3 
6.2 
5.3 
0.2 



86.5 
7.7 

5/8 
0.0 



87.6 
7.4 

5.0 

°"( 

1,270 



89.4 
5.5 
4.7 
0.3 
1,192 



84.9 
5.0 

10.1 
0.0 



94.8 
1.3 
3.9 
0.0 

155 



Thus, the N's for the Representative Comparison and Nominated Schools 



ERIC 



82.6 
9.0 
8.0 
0.3^ 



1,762 182 3,717 



83.4 
9.4 
7.0 
0.2 



1,603 157 3,393 



84.3 
8.9 
.6.6 
0.2 



1,622 171 3,338 



85.6* 
8.0 
6.3 
0.1 



1,253 155 2,916 



85.9 
7.7 
6.3 
0.1 



159 2,659 



88.1 
6.3 
5.3 
0.2 
2,260 



290 



Table A2-3 



Percentages of Students With and Without CTBS Reading Scores for Fall and Spring by 
School Sample and Participation in Free or Reduced-Price Meal Programs* 



CTBS Reading 
^ Scores 
Available 



Students in Entire Sample 

Won- Free-Meal 
Participant Participant 



Students in Representative Sample 



Non- Free-Meal 
Participant Participant 



Total 



Grade 1 














Fall * Spring 


86.4 


77.5 


82.5 


86.8 


76.5 


82.8 


Fall Only 


7.1 


12. 1 


9 . 3 


6.^ 




9 . 3 


Spring Only' 


6.1 


10.2 


8.1 


6.3 


10.2 


7.8 


Neither Time 


0.0^ 


0.2 


0.1 


0.0 


0.1 


0.1 


N 


11,599 


8,810 


20,409 


8,798 


5,466 


14,264 


Gr^de 2 




79*/2 










Fall & Spring 


87.7 


84.0 


88.2 


79.1 


84.7/ 


Fall Only 


6. 3 


11.3 


8.4 


5 . 9 


11.9 


8 . 2 


Spring fnly 


,6.0 


9.4 


7.«i 


5.9 


8.9 


7.1 


Neither Time 


'o.o 


0.1 


0.1 


0.0 


0.1 


0.0 


N 


10,458 


7,901 


18,359 


7,903 


4,817 


12,720 


Grade 3 










t 




Fall *■ Spring 


88.2 


80.9 


85.0 


88.7 


80.8 


85.6 


Fall Only 


5.6 


10. 5 


7 . 8 


5 . 2 


11.0 




Spring Only 


6.1 


8.4 


7.1 


6.1 


8.0 


6.9 


Neither Time 


0.1 


, 0.2 


0.1 


0.1 


0.2 


0.1 


H 


9,987 


3,040 


18,027 


7,711 


4,886 


12,597 


Grade 4 














Fall & Spring 


89.8 


81.8 


86.3 


90.2 


80.8 


86.5 


Fall Onlv 


5.2 


10. 3 


7 . 4 


4.8 


11.3 


7.4 


Spring Only 


5.0 


7.7 


6.2 


4.9 


7.7 


6.0 


Neither Tine 


0.1 


0.1 


0.1 


■ £.1 


0. 1 


0.1 


M 


10,036 


7.731 


17,767 


7,456 


4,825 


12,281 


Grade 5 














Fall £ bprmg 


90.4 


84.2 


87.7 


90.6 


83.7 


87.9 


Fall Only 


5.0 


9.0 


6.^ 


4.9 


9.4 


6.6 


Spring Cnly 


4.6 


6.6 


5.4 


4.5 


6.7 


5.3 


Neither Time 


0.0 


0.2 


0.1 


0.0 


0.2^ 


S o.i 


u 


10,375 


8,014 


18,389 


7,681 


4,849 


12,530 


Grafle 6 














Pall & Spring 


91.7 


86.0 


89.6 


92.3 


85.6 


90.2 


Fall <*iy 


4.6 


8.0 


5.9 


4.3 


8.6 


5.7 


Spring Cnly 


3.7 


5.8 


4.5 


3.4 


5.6 


4.1 


Neither Time 


0.0 


0.2 


0 1 


. o.o s 


0.2 


0.1 


H 


1 3 , 092 


7,723 


20,815 


10,162 


4,591 


14.753 



Students m Comparison Sample 



Students m Nominated Sample 



Non- Free-Meal 
Participant Participant 



Total 



Non- Free-Meal 
Participant Participant 



Total 



ERIC 



O aall number 06 students in the Feeder Schools have not been tabulated here, 
"t add to that for the entire sample. 



83.9 
8.9 
7.0 
0.1 

1,252 



85.2 
7.9 
6.9 
0.0 

934 



8%. 9 
6.9 
5.2 
0.0 

1,015 



90. 1 
5 9 
4.0 
0.0 

1,076 



V»1.0>- 
5.0 
4.0 
0.0 

847 



74.0 


79.8 


86 ^ 


80.7 


82.8 


11.7 


10.1 


7.0 


16.0 


8.9 


14.2 


10.0 


6.7 


8.8 


8.0 


0.0 


0.0 


0.1 


0.4 


0.3 


894 


2,146 


1,395 


2,322 


3,717 



86.8 


73.7 


81.3 


85.9 


82.5 


83.8 


5.9 


10.6 


7.9 


8.3 


9.8 


9.2 


7.3 


15.6 


10.8 


5.8 


7.6 


6.9 


0.0 


0.1 


0.1 


O.O 


0.2 


0.1 


1,144 


828 


1,972 


1,264 


2,129 


3,393 



77.4 
9.2 

13.3 
0.0 

909 



79.8 
9.2 

10.9 
0.1 

006 



01.4 
8.6 
10.0 

0.0 

1,843 



84.1 
8.0 
7.9 
0.1 

1,921 



87.9 


82.6 


84.5 


6.8 


10.0 


8.8 


5.2 


7.3 


6.5 


0.2 


0.2 


0.2 


1,223 


2,115 


3,338 



87.3 


84.5 


85.6 


7.0 


8.6 


7.9 


5.7 


6.8 


6.3 


0.1 


0.1 


0.1 


1,177 


1,739 


2,916 



84.0 


87.7 


8(i.3. 


84.9 


86.1 


8.6 


7.0 


5.9 


8.4 


7.5 


7.2 


5.3 


5.0 


6.6 


6.3 


0.1 


0.1 


0.0 


0.2 


0.1 


721 


1,797 


966 


1,693 


2,659 


85.9 


88.8 


90.0 


87.2 


88.2 


6.5 


5.6 


5.3 


7.1 


6.5 


7.5 


5.6 


4.7 


5.5 


5.2 


0.0 


0.0 


0.0 


0.2 


0.1 


676 


1,5*3 


All 


1,449 


2,260 



Thus, the N's for the Representative, Comparison, and Nominated Schools 
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Math 



Table A2-4 * 

Percentages of students With and without CTBS "Hath Scores for Fall and Spring by 
School sample and Participation in Free or Reduced-Price Meal Programs* 



CTBS ; 

Scores 
Available 



Students in Entire Sample students in Representative Sample 



Grade 1 

Fall £ Spring 
Pall Only 
Spring Only 
Neither Tire 

N 

Grade 2 

Fall £ Sprang 
Fall Only 
Spring Only 
Neither Time 

N 

Grade 3 . 

Fall "X Spring 
Pall Only 
Spring Only 
Neither Time 

U 



Grade 4 

■ Pall £ Spring 
Fall Only 
Spring Only 
Neither Time 

N 



Grade 5 

Fall £ Sprang 
Fall Only 
Spring Only 
Neither Time 

N 



Grade 6 

Pall £ Spring 
Fall Only 
Spring Only 
Neither Time 



Non- Free-Meal yj0n ." Fre e-Keal _ , 

Participant Participant Total Participant PartiSipant 10631 



86.2 


77.3 


82.4 


86.6 


7.2 


12.2 


9.4 


6.9 


6.5 


10.2 


8.1 


6.4 


0,1 


0.4 


0.2 


0.0 


11,599 


8,810 


20,409 


8,798 



76.3 
13.1 
10.2 
0.4 



82.7 
9.3 
* 7.9 
>0.2 

14,264 



87.5 


79.0 


83.9 


88.1 


78.8 


84.6 


6 . 3 


11.3 


8 . 5 


5.9 


11.9 


8.2 


6.1 


9.4 


7.5 


6.0 


8.9 


7.1 


O.l 


0.3 


6 0.2 


0. 1 


0. 3 


0 . 2 


10,458 


7,901 


Iff, 359 


7,903 


4,817 


12,720 


88.2 


80.7 


84.9 


88.6 


80.6 


85.5 


5. 7 


10 . 6 




^ 5.2 


11.2 


7.5 


6.1 


8.4 


7.1* 


6.1 


8.0 


6.9 


0.0 * 


0.2 


0.1 


0.0 


0 . 2 


0. 1 


9, 987 


8,040 


18,027 


7,711 


4,886 


12,597 


89». 6 




86 . 1 


90.0 


80.5 * 


86.3 


5.2 


10.5 


7.5 


' 4.9 


11.5 


7.5 




7.6 


6.2 


5.1 




6.0 


0.1 


0.3 


0.2 


0.1 


^6.4 


0.2 


10,036 


7,731 


17,767 


7,456 


4,825 


12,281 


90.3 


84.1 


87.6 


90.4 


83.7 


87.8 


5.0 


9.1 


6.8 


5.0 


9,5 


6.7 


4.6 


6.5 


5.4 


4.5 


6.6 


5.3 


0.1 


0.2 


0.1 


0.1 


0.<: 


0.1 


10,375 


8,014 


18,389 


7,681 


4,849 


12,530 


91.5 


85.9 


89.4 


92.1 


85.4 " 


90.0 


4.7 


8.i 


5.9 


4.4 


8.7 


5.8 


3.8 


5.8 


4.5 


3.4 


5.8 


4.1 


0.1 


0.2 


0.1 


0.1 


0.1 


0.1 


13,092 


7,72*1 


20,815 


*10,162 


4,591 


14,753 



I • 

The small number of students in the Feeder Schools have not beon tabulated her- 
do not add to that for the entire sample. 



:RiC 



Students m Comparison Sample Students in Nominated Sample 



Non- Free-Meal 
Participant Participant 



Total 



Total 



era. 9 


73.5 


79.5 


85.8 


80.7 


9.1 


12.4 


10.5 


7.2 


10.1 


7.0 


13.8 


9.8 


6.8 


8.7 


0 . 0 


0 . 3 


0. 1 


0.1 


0.4 


1,252 


894 


2,146 


1,395 


2,322 


86.5 


73.8 


81.1 


85 . 5 


82.2 


6.0 


10.1 


7.8 


8.5 


10.0 


7 . 4 


15 .9 


11.0 


5.9 


7.6 


0.1 


0.1 


0.1 


0.1 


0.3 


1,144 


828 


1,97? 


1,264 


2,129 


85.5 


77.8 


81.7 


88.0 


82.1 


7.8 


9.0 


8.4 


6.7 


10.2" 


6.5 


* 13.2 


9.8 


5.3 


7.3 


0. 1 


0.0 


0.1 


0.0 


0.3 


034 


* 909 


1,843 


1,223 


2,115 



87.7 
6.7 
5.5 
0.1 

1,015 



90.6 
5.2 
3.8 
0.4 

1,076 



90. 3 
5.3 
4.4 
0.0 



84 7 



79.7 
9.7 

10.3 
0.3 

906 



84.6 
8.6 
6.7 
0.1 

721 



85.7 
7.0 
7-2 
0.1 

676 



83.9 
8.1 
7.8 
0.2 

1,921 



87.2 
7.0" 
5.8 
0.1 

1,177 



84.5 
8.6 
6.7 
0.2 

1,739 



82.6 
9.0 
8.0 
0.3 

3,717 



83.4 
9.4 
7.0 
0.2 

3,393 



84.3 
8.9 t 
6.6 
0.2 

3,338 



85.6 
8.0 
6.3 
0.1 



88.2 


88.2 


84.6 


85.9 


6.6 


5.9 


8.7 


7.7 


5.0 


5.9 


6.6 


6.3 


0.3 


0.0 


0.1 


0.1 


1,797 


966 


1,693 
o 


2,659 



88.2 


89.6 


87.3 


88.1 


6.0 


5.4 


6.8 


6.3 


5.6 


4.9 


5.5 


5.3 


0.1 


0.0 


0.3 


0.2 


1,523 


811 


1,449 


2,260 



Thus, the N's for the Representative, Comparison, and Nominated Schpo 
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Table A2-5 

Percentages of Stidents With and Without CTBS Reading Scores for Pall and Spring by 
School Sample and Levels of Mother's Educational Attainment* 



CTBS Reading 
Scores 
Available 



Grade 1 

Pall t Spring 
pall Oily 
Spring Only 
Neither Tine 

N 

Grade 2 

Fall t Spring 
pall Only 
Spring Only 
Neither Time 

N 

Grade 3 

Pall i Spring 
Pall Only 
Spring Only 
Neither Time 



Grade- 4 

Fall & Spring 
pall Only 
Spring Only 
Neither Time 

N 

Grade S 

Pall & Spring 
Pall Only 
Spring Only 
"r^Ver Time 



Grade 6 

Pall & Spring 
Pall Only 
Spring Only 
Neither Time 



Students in Entire Sample 



Less Than High 
High School 
School Gred 



College 
Grad 



Total 



78.2 
12.0 
9.5 
0.3 



82.1 
10.1 
7.8 
0.0 



83. 5 
9.5 
6.8 
0.2 



84.5 
8.1 
7. "3 

6 A 



85.7 
8.1 
5.9 
0.2 



88.1 
6.7 
5.2 
0.1 



86.6 90.6 



7.2 
6.2 
0.1 



- 5.4 
3.9 
0.0 



87.8 
^6.3 
5.9 
0.0 



92.2 
4.2 
3.6 
0.0 



88.0 
6. -3 
5.7 
0.0 



4.7 
4.2 

0.0 



89.1 
5.8 
5.0 
0.1 



92.6 
4.1 
3.2 
0.1 



90.7 
5.0 
4.3 

o.c 



94.3- 
3.1 
2.6 
0.0 



91?/' 
4.4 
3.8 

0,0 



94.7 
3.4 
2.0 
0.0 



84.8 
8.2 
6.9 
0.1 



3,592 9,275 1,218 14,085 



86.8 
7.1 
6.1 
0.0 



3,107 8,511 1,122 12,740 



7.0 
5.9 
0.1 



3,376 8,160 1,154 12,690 



88.2 
6.3 
5.5 
0.1 



Students in Representative Sample 



Less Than High 
High School 
School Grad 



Total 



3,357 7,835 1,15^ 12,348 



89.7 
5.7 
4.6 
0.1 



3,454 8,350 1,194 12,998 



91.1 
4.9 

0.0 



3,784 9,468 1,371 14,623 



77.0 
13.0 
9.8 
0.2 



82.8 
9.8 
7.4 
0.0 



83.7 
9.6 
6.6 
0.1 



8.4 
7.2 
0.1 



85.3 
8.5 
5.9 
0.3 



7.0 
4.3 
0.1 

2,641 



86.8 
6.9 
6.2 
0.1 



90.9 
5.3 
3.8 
0.0 



84.9 
8.2 
6.8 
0.1 



2,423 6,781 1,094 10,208 



88.1 
6.2 
'5.7 
0.0 



2,102 6,227 



88, & 
5.7 
5.4 
0.1 v 

5 ;975 



S.7 
5.1 
0.1 

5,719 



4.6 
4.1 

0.0 



4.0 
3.5 

0.0 



87.2 
6.9 
5.9 
0.0 



87.8 
6.5 
5.6 
0.1 

9,147 



88. 3 
6.2 
5.4 
0.1 



5.4 
4.4 

0.1 



91.8 
4.6 
3.5 
0.0 



1,103 10,727 



4-5 
3.9 
0.0 



4.6 
4.1 

0.0 



4.0 
3.2 
0.1 



2.7 
2.2 
0.0 



3.0 
1.9 
0.0 



Students in Comparison Sample 



Less Than High 
'High School 
School Grad 



College 
Grad 



78.3 
U.4 
10.3 
0.0 

290 



80.4 
9,8 
9.8 
0.0 

194 



80.2 
9.5 
10.3 

0.0 

359 



81.6 
9.6 
8.9 
0.0 

293 



83.6 
8.9 
7.5 
0.0 

280 



83.8 
6.2 

10.0 
0.0 

260 



83. < 
10.2 
6.4 
0.1 

1,022 



86.5 
5.7 
7.6 
0.1 

785 



82.6 
8.7 
8.7 
0.0 

826 



88.1 
6.2 
5.7 
0.0 



737 



6.8 
4.G 
0.1 



9?. 7 
4.2 
3.1 

0.0 

645 



89.5 
6.3 
4.2 
0.0 

95 



95.8 
1.7 
2.5 
0.0 

119 



87.5 
6.3 
6.3 
0.0 

80 



92.2 
4.9 
2.9 
0.0 

10 3 



2.0 
5.9 
0.0 



93.3 
2.7 
4.0 
0.0 

75 



82.7 
10.2 
7.0 ( 
0.1 

1,407 



86.4 
6.0 
7.5 
0.1 

1,098 



82.2 
8.8 
9.0 
0.0 

1/26S 



86.8 
7.0 
6.3 
0.0 

1,133 



6.9 
5.5 
0.1 



90.4 
4.6 
5.0 
0.0 

980 



Students in Nominated Sample 

Less Than High 

High School * J? Total 



81.0 
9.4 
8.8 
0.7 

838 



81.6 
10.3 
8.1 
0.0 

778 



84.3 
9.2 
6.0 
0.5 

750 



7.3 
7.7 
0.0 



6.8 
6.2 
0.2 



5.3 
5.3 
0.0 



87.9 
6.2 
5.8 
0.1 

1,394 



6.9 
5.5 
0.1 

1,401 



88.0 
7.5 
4.5 
0.0 

1,297 



7.3 
4.6 
0.1 



5.7 
4.9 
0.1 

1,092 



o.4 
4.3 
0.0 

858 



87.6 
6.2 
6.2 
0.0 

97 



87.5 94.9 



3.1 
2.0 
0.0 

98 



91.9 
, 4.0 
v 4.0 
0.0 

99 



87.9 91.3 



5.4 
3.3 
0.0 

92 



89.3 88.6 



7.6 
3.8 
0.0 

79 



89.3 89.9 



7.2 
2.9 
0.0 

69 



O eachers were allowed to mark a "response alternative 'cannot estimate 1 m the item about mother's educational attainment, 
rn 1/^ considerably reduced by counting such responses as missing data. 0/1/9 



sample sizes in this 



"CTBS Math 
Scores 
Available 



Grade 1 

Pall & Spring 
Pall Only 
Spring Only 
Neither Tine 



Grade 2 

Fall & Spring 
Pall Only 
Spring Only 
Neither Time 
N 

Grade 3 

Pall 4 Spring 
Pall Only - 
Spring Only 
Neit-Mr Time 



Grade 4 

Pall & Spring 
Fall Only 
Spring Only 
Neither Tine 



Grade S 

Fall & Spring 
Fall Only 
Spring Only 
Neither Tiate 



Grade 6 

Fall & Spring 
Fall Only 
Spring, Only 
Neither Tine 



4- 



Table A2-6 

Percentages of students With and without CTBS Math Scores for Fall and Soring by 
School Sample and Aevels of Mother's Educational Attainment* * 



Students in Entire Sample 



Less Than High 

High School Total 
School Crad Crad 



77.9 
12.0 
9.7 
0.4 



81.7 
10.2 
7.8 
0.3 



34.3 
^8.5 
7.0 
0.2 



85.6 
8.4 
5.7 
0.3 



86. 3 
7.4 
6.3 
0.1 



90.4 
5.5 
4.0 
0.1 



'84.5 
8.4 
6.9 
0.1 



3,592 9,275 1,218 14,085 



87. 7 
6.4 
5.9 
0.0 



92.1 
4.1 
3.8 
0.0 



86.6 
7.1 
6.2 
0.1 



3,107 8,511 1,122 12,740 



88.9 
5.9 
5.1 
0.1 



92.5 
4.2 
3.3 
0.1 



88.0 
b.S 
5.5 
0.1 



3,357 7,835 1,156 12,348 



90.6 
5.0 
4.3 
0. 1 



94.1 
3.4 
2.6 
0.0 



Students in Representative Sample 



Less Th/n High 

High school Colle 9« Xotal 
School Grad 



76.7 
13.1 

9. 9~ 
0.3 



86.6 
7.0 
6 r 3 
0.1 



90.8 
5.3 
3.8 
0.1 



84.6 
8.3 
6.9 
0.1 



2,423 6,781 1,004 10,208 



82. 3 
9.9 
7.5 
0.3 



88.0 
6.2 
5.7 
0.0 



2,102 6,227 



91.6 
4.4 
4.1 
0.0 

888 



87.1 
6.9 
5.9 
0.0 



83.4 


87.9 


91.2 


87.0 


83.5 


88.7 


91.2 


87.7 


9.5 


6.3 


4.7 


7.0 


5.7 


5.8 


4.6 


6.6 


7.0 


5.6 


4.2 


5.9 


6.6 


5.4 


4.2 


5.6 


0.1 


0.1 


0.0 


! 0.1 


0.2 


0.1 


0.0 


0.1 


3,376 


8,160 


1,154 


12,690 


2,221 


5,9?5 


951 


9,147 



84.0 
8.9 
6.9 
0.2 



88.9 
5.8 
5.3 
0.1 



2,248 5,719 



89.6 
5.8 
4.5 
0.1 



3,454 8,350 1,194 12,998 



85.1 
8.9 
5.8 
0.3 



91.1 
4.7? 
4.2 

o.r 



2.398 6,058 



92.6 
4.1 
3.2 
0.1 

932 



94.8 
2,8 
2.3 
0.0 

948 



88.1 
6.4 
5.5 
0.1 



89.9 
5.6 
4.4 
p.l 

9,404 



Students in Comparison Sample 



Less Than High 
High 
School 



School 
Grad 



College 
Grad 



77:6 
12.1 
9.7 
0.7 



82.8 
10.9 
6.4 
0.0 



29Q l ,022 



79.9 
10.3 
9.8 
0.0 

194 



80.8 
9.2 

10.0 
0.0 

359 



86.6 
5.6 
7.8 
0.0 

785 



82.9 
8.4 
8.6 
0.1 

826 



89.5 
6.3 
4.2 
0.0 

95 



95.0 86.3 

1.7 6.0 

3.4 7.7 

0.0 0.0 

119 1,098 



Students in Nominated Sample 



Less Than 
High 
School 



H *9h _ 

Col lege 

Grad 



School 
Grad 



Total 



82.2 


80.9 


87.9 


85.6 


85.3 


10.8 


9.1 


6,4 


7.2 


7.4 


6.9 


9.5 


5.7 


7.2 


7.1' 


0.1 


0.5 


0.0 


0.0 


0.2 


1,407 


838 


1,394 


97 


2,329 



88.8 
6.3 
5.0 
0.0 

80 



82.7 
8.5 
8.8 
0.1 

1,265 



84.3 
8.2 
6.8 
0.7 

280 



89.0 
6.3 
4.4 
0.3 

711 



91.2 
3.9 
4.9 
0.0 

102 



88.0 
6.6 
5.0 
0.4 

1,093 



87.9 


<>1.6 


94.8 


' 90.9 


88.3 


92.3 


95.2 


91.6 


83.1 


92.4 


93.3 


90.0 


6.7 


4.5 


3.2 


5.0 


7.0 


4.1 


2.9 


4.7 


6.2 


4.2 


2.7 


4.6 


5.3 


3.9 


1.9 


4.0 


4.5 


3.6 


1.8 


3.6 


1C.8 


3.4 


4.0 


5.4 


0.2 


0.0 


0.1 


0.1 


0.2 


0.0 


0,1 


0.1 


0.0 


0.0 


0.0 


0.0 


3,784 


9,468 


1,37. 


14,623 


2,641 


6,983 


1,103 


10,727 


260 


645 


75 


980 



81.4 
10.,? 
8.1 
0.3 

778 



84.1 
9.2 
6.7 
0.0 

750 



87.2 
7.3 
5.6 
0.0 

1,401 



87.9 
7.5 
4.5 
0.2 

1,297 



93.9 
3.1 
3. 1 
0.0 

98 



91.9 
4.0 
4.0 
0.0 



99 



87.0 
7.0 
6.0 
0.0 

599 



89.8 
4.5 
5.1 
0.6 

511 



89.3 88.6 

5.8 7.6 

4.9 3.8 
0.1 0.0 



1,092 



88.8 
6.6 
4.5 
0.0 



858 



79 



89.9 
7.2 
2.9 
0.0 

69 



85.5 
8.1 
6.3 
0.1 

2,277 



86.8 
7.9 
5.2 
0.1 

2,146 



81.6 


88.2 


91.3 


86.8 


85.2 


87.9 


91.3 




10.2 


6.1 


4.9 


7.1 


7.5 


7.3 


5.4 


7.3 


7.8 


5.7 


3.9 


6.1 


7.3 


4.6 


3.3 


5.5 


0.3 


0.0 


0.0 


0.1 


0.0 


0.1 7 


0.0 


0.1 


293 


737 


103 


1,133 


627 


' 1,119 


92 


1,838 •» 



88.5 
6.3 
5.2 
0.1 

l,770j 

i 

89.2 
5.9 
4.7 
0.2 

1,438 



Because teachers were allowed to mark a response alternative 'cannot estimate* in the item about mother 
table are considerably reduced by counting such responses as missing data. 

9 



s educational attainment,, sample sizes in this 
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APPENDIX B 



MATERIALS SUPPORTING CHAPTER 2 



Bl Supplementary Text and Tables for Norm- 
Referenced Analyses 



B2 Supplementary Tables for Analyses of Variance 

B3 Supplementary Text and Tables for Analyses of 
Covariance ; 



B4 Supplementary Tables for Comparisons of Gains 
Conditional on Pretest Scores 



B5 Supplementary Text and Tables for Comparisons 
with Expected Growth 
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APPENDIX Bl 



SUPPLEMENTARY TEXT AND TABLES 
FOR NORM-REFERENCED ANALYSES 
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Two Refined Norm-Referenced Criteria 



Two refinements of Criterion A, percentile maintenance , are described below. 

1. Projected mean VSS gain for the group of students with sinrttar fall 
percentile ranks. In anticipation of some differential growth among 
students at different achievement levels, national projections were 
made for ten subgroups of .students, each achieving at a different 
decile in the fall. The projected means and standard deviations' of 
the VSS gains for the , recommended-level 1 test scores are presented 
in Table Bl-1. The* projected mean VSS'gains for students in "the popu- 
lation whose pretest decile scores are equal to those for CE -students 
is used as the criterion. TJo determine the value of this criterion, # 
the observed pretest mean VSS for the analysis group i^s converted to 
a percentile rank P Q using the fall norm and then the projected mean 
VSS gain for the pretest percentile interval that includes P Q is found 
from Table B2-1 and used as the criterion. 

As the students were divided into ten achievement groups based on their 
* percentile ranks to compute the projections, some regression effects 
may be present in the projected gains for each group. However, they 
are expected to be sm^ll because of the large group size and the high 
test reliabilities. Another problem is that inclusion of CE students 
in the projection introduced some confounding: the projected gains 
may be inflated if CE has positive effects. Inspection of our data 
reveals that this is not a conceirn. 1 

Nonetheless, it is important to no£e that where this is the situation/ 
the mean gain for CE students in tfhat achievement gfoup would still be 
larger than the projected mean, aid if it is substantially larger we 
would have great confidence that positive effect will be fopnd. On 
the other hand, if this is not tie situation, whether CE students are 
included in the projection or not t no positive effect can be found. 



The same contaminating CE effect 



may also be a concern in the use of 
norms to set a comparison standald. This contamination is expected to 
have little influence in our eva! uation. The reason is that if CE 
students achieve considerably be' ter in the spring than non-CE students, 
the non-CE students with smaller toains would be shuffled down to the 
lower ranks. Consequently, using\the difference in the fall and spring 
VSSs for a given percentile rank ror comparison (e.g., the percentile- 
maintenance criterion) will properi^ show a higher gain for CE students. 
Again, if there are nb positive effects of CE, our criteria derived 
from the norms cannot^ erroneously show positive effects. Incidentally, 
this concern of confounding CE effectsVLn the norms is applicable to 
all other recent norms , as CE programs rave been in effect for more 
'than a decade and publishers' standardiz^ipns have not been able to 
exclude CE students either. 
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* Table Bl-1 * \ « 

Projected Means and Standard Deviations for VSS Jg$ins by Categories of« Pretest Achievement Status* J~ 

. . .. , _ . 



Pretest (fall) 
Percentile Rank 



Grade 1 



Grade 2 



Grade 3 



Mean * S.D. Mean | S.D. 



Mean 



S.D. 



Grade 4 



Mean S.D. 



Grade 5 



* Mean S.D. 



Grade 6 



Mean 



HEADINl 



> 



MATH 



y 



i-io . 

11-20 
21-30 
31-40 
'41-50 
1^51-60 
61-70 
71-80 
81-90 
91-99 

Total $ 



1-10 
11-20 
21-30 
31-40 
' 41-50 
51-50 
61-70 
71-80 1 
81-90 
91-99 

1 Total 



79.1 
70.2 
65.9 
63.2 
65.1 
64.6 
64.2 
65.6 
66.0 
61.6 



*78.3 
66.9 
62.2 
61.4 
63.9 
62.2 
61.6 
57.1 
58.3 
50.5 



33.4 
36.2 
36.6 
36.9 
32.1 
29.9 
33.3 
36.1 
36.9 
37.5 



66.7 35.4 



37.0 
33.2 
32. 2 
35.0 
33*. 8 
31.0 
32.0 
33.8 
33.2 
34.4 



62.4 34.3 



59.5 
44.7* 
40.8 
,43.5 
^44.3 
45.3 
49.4 
45.9 
39.7 
28.3 



75.8 
65.6' 
5,7.1 
61.3 
58.2 
57.8 
55.1 
53.7 
50.3, 
43.3 



38.4 
36.7 
33.4 
32.1 
, 30.0 
28.7 
28.2 
24.0 
26.2 
30.1 



43.9 31 .V 



40.9 
39.4 
37.6 
35.5 
33.2 
32.6 
30.8 
32.0 
32.6 
38.3 



57.5 36.3 



50.8 
32.3 
36.0 
39.1 
38.0 
32.3 
27.8 
28.0 
33.3 
25.7 



71.4 
64.9 
62.0 
62.7 
62.4 
60.4 
59.2 
57.7 
59.9 
48.2 



37.2 

29.4 

30.3 

27.9 

26.8 

23.1 

24. i* 

28.7 

32.7 

35.1 



34.5 30.7 



43.6 
38.6 
37.5 
35.5 
36.3 
35.5 
36.2 
41.1 
46.4 
45.3 



60.7 40.1 



49.5 


39.5 


4*3.3 


41.5 


37.8 


40 c .0 * 


31.1 


34.8 


26.6 


37.3 


28.7 


32.0 


25.6 


30.1 


25.1 


32.8 


22.0 


* 25.8 


26.7 


26.2 


27.4 


26.1 


•!20.6 


22.8 


25.1 


26.8 


25.0 


21.6 


23.2 


23.7 


30.8 


25.0 


24.4 


21.9 


27.8 


27.6 


32.1 


23.2 


24.2 


25.3 " 


31.4 


31.0 


32.4 


27.2 


29.3 


2§.8 


34.9 


32.0 


25.0 


31.3 


31.7 


32.0 


29.2 


33.8 


13.8 . 


35.6 


20.9 


31.4 


14.0^ 


- 28.9 


29.2 


31.5 


27.6 


30.7 


26.9 


. 30.9 . 




52.2, 41.0 



S8.7 
51.6 
45.4 
48.6 
44. \ 
45. 5 V 
42.7. 
40.9 
44/7 
35.9 



48.2 

46.1 

i':>.9 

44.3 

41.7 

40.1 

39.5 

46.6 

43.2* 

47.2 



60.1 
46.7 
42.1 
43.3 
37.7 
44<£ 
43.1 
48.3 
45.1 
27.9 



50.2 
44.1 
40.2 
44.3 , 
41. 
45. 
45. 
46. 
48. 
44. 



.9 
.6 



45. 8^ 44.4 



44.1 45.8 



The projections are based on test scorfeSifor the "recommended level* (see # tjje text of Chapter 1 for an explanation 
of the test' level) . \ 



9 

ERLC 



293 



' \ • 

For the benefit of readers wHb would like to make their own assessment 
of the extent of confounding CE effects in the norms and the projected 
e mean gains, we note that the largest projected percentages of CE stu- 
dents are* always found in the lowest achievement group. N These percen- 
tages range from -38 to 58 for reading and from 26 to, 35 for" math. In 
every grade, the percentages decrease rapidly with pretest* achievement 
level and drop down to less than 20 percent in most cases, at the median 
level. * * 

* ? #- « 

2. VSS gain required 'to maintain a percentile rank- that is the midpoint of. 
the 'decile 9 associated with the mean fall VSS for* tYt^ group This 
criterion is similar to the first criterion except that the midpoint 
of the 'tenth 1 in the pretest distribution that'covers the group's v * 

average percentile ranks ,*'P 0 , is employed as the* ^reference £erqenti4e. 
As an illustration, consider an analysis group for which P Q -is 23. 
The 'tenth 1 containing P Q is then the percentile interval 21-30, and 
, thus the reference percentile becomes 25. This criterion is adopted 
to provide a check for the stability of the 'percentile-maintenance • 
priterion against estimation errors for P Q . 

When the achievement growth is examined for all CE students combined (as in 
Table 2-1), values for the first criterion are 66, 41, 34, 26, 26,, and 25' for 
reading; and 62, 57, 62, 53, 45, and 42 for math. The values for the second 
criterion are 55, 40, 34, 32, 39, and 31 for reading, 'and 54, 52, 57, 49„40, 
and 41 for math. 

t 

Based on the data in Table 2-1, for the first grade, Criterion 1 is ^considerably 
more stringent than othera and represents the only criterion that is -not satis- 
fied. This observation applies to both reading and math, and could par.tly be. 
a consequence of the low^r test reliabilities at this grade >and thus larger / 
regression effects. *0n the other hand, this criterion is less stringent than 
most others for reading at grade 4, the only positive finding obtained among 
the .criteria. The results for the second criterion agree with those for the 
•percentile-maintenance' criterion with only^ one exception. For'reading at 
grade 4, an ambiguous bit of evidence is found for the latter instead of the 
no evidence for the former. TKe parallel findings between the second criterion 
and the percentile-maintenance criterion indicate some stability for the equi- 
percentile growth criterion within a range of percentile rank. Because these 
two refined criteria provide either conflicting information (criterion 1) or 
merely replication (criterion 2) , we will not discuss them further in this 
Appendix. . • ' 

* 

Uorm-Referenced Analyses by Demographic Characteristics of Schools *" 

» 

% Tables Bl-2 through Bl-6 present the results of the norm-referenced analyses 
by demographic characteristics of schools. These analyses implement the norm- 
referenced standards on a group basis (see Chapter 2 for an explanation of how ■ 
to set this criterion) . The results of the corresponding norm-referenced 
analyses that implement the standards on an individual basis (to be explained 
in a subsequent section) are provided in Tables Bl-9 through Bl-13.. The fin- 
dings in the two sets of analyses are similar, so we will discuss only the re- 
sults for the group-level analyses. 

Tables Bl-2 and Bl-3 present the results for the analyses by geographic region 
and by urbanism, respectively. The Northeast represents New England, Metro- 
politan Northeast, and Mid-Atlantic of the ten Federal regions. The North 
Central comprises the North Midwest, Central Midwest, and North Central re- 
gions. The Northwest region is simply the Pacific Northwest in the Federal 
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demarcations . The Sou tn" includes the Southeast, South Central, and Pacific 
, Southwest regions* For reference, see Figure 2-1 of Report 5* The ^degree of^ 
urbanism for the schools was defined in terms of school's locale* The category 
•city 1 includes all schools located in cities with populations greater than 
50,000* The category 'suburb or small city' refers to schools in suburbs or 
cities with populations less than 50,000. The 'rural' category consists of all 
schools in rural areas. 

S 

The major .findings from these two tables are: 

• In reading, positive results are observed for grade 3, except 4 in 
/the Northeast region. Referring to Table 2-3, this exception 

could possibly be a result of more other-CE students and higher 
pretest scores for CE students in the Northeast, compared with 
other regions* 

• In math, the analyses with the percentile-main tenancy criterion 
show positive effects of CE in grades 1 and 4 in the South, in 
grades 4 and 5 in the Northwest, and in grade 1 in the Northeast.. 

' * In all other ^nalyses, few positive results are obtained* 

These findings suggest that divisions into homogeneous regions with respect to 
concentrations of low-achieving students do not enhance the chances for detec- 
ting* positive effects of CE. 

• \ While there is little evidence for positive effects in the overall 

analysis for grade 5 in reading, a positive finding is obtained 
^ for rural, areas In this case. Positive effects are also obtained 

for rural areas in grade 2 in reading. Except for sampling dif- 
% ferences, we are. not aware of a good explanation for these specific 
« findings. % < * 

• id math, analyses with the percentile-maintenance criterion produce 
positive results for cities butr not for rural areas at grades 1, 2, 

. "and 4. This finding may be an indication of greater emphasis on 
* - math CE in 5ities than in rural areas. However, the higher pretest 

mean for CE students in rural areas could in part explain the results, 
considering regression effects. 
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As in th£ analyses by regions, subset analyses by urbanism fail to reveal a 
better picture of CE effects than in the overall analyses . 

Tables Bl-4 and,Bl-5 display the results for analyses by school's concentra- 
tions of minority and poverty students, and by school's concentration of low- 
achieving students, respectively . The concentration of poverty students is 
defined in terms of the percentage of students participating in free-meal pro- 
grams* The low-achieving students refer to those scoring at or below the 33rd 
p percentile rank at the pretest time, and are determined for reading and math 
separately. Some highlights of 'the findincrs in these two sets of analyses are: 

♦ 

• In reading, positive effects are detected in the subset of schools 
with high concentrations of minority and poverty students at grades 
1 and 3. In contrast, schools with low concentrations of poverty 
students, regardless of their concentrations of minority students, 
tend to show positive effects of CE in grade 2. Such inconsistent 
results among grades makes it difficult to generalize the findings 

„j - in these 'respects. 

* • In math, there are slight positive effects in schools with high 
concentrations of minority and poverty students (at grades 1, 2, 
4, and 5). This result may, however, partly be a reflection of 
the large sampTe~~slz~es for. this group of CE students. 

• In reading, positive effects of CE are observed primarily in 
schools with high concentrations of low achievers at grades 1 and 
3. This finding is consistent' with an earlier one showing posi- 
tive effects in these two grades for Title I students, who tend 
to be in schools with high concentrations of low achievers. 

• In the first two grades, positive effects of CE in math are 
obtained only in schools with high concentrations of low 
achieverr,. 

The findings with respect to concentrations of low achievers suggest that 
schools with more need to provide CE services-tend to make greater efforts and 
produce better results. 

The last set of anlyses by schools' demographic characteristics was performed 
for subets of schools by levels of their per-pupil expenditures in regular and 
compensatory education. The results are summarized in Table, Bl-6. Some note- 
worthy findings include: 

• In grades 1 and 3, positive effects of CE in reading are obtained 
for schools with high per-pupil CE expenditures. In grades 5 and 
6, evidence for positive effects of reading CE is observed in 
schools with high expenditures for both regular and compensatory 
education. 

• In grades 3, 5, and 6, schools with higher CE expenditures, especial- 
ly those also with higher regular expenditures, show a more positive 
picture for the effects of CE in math. Elsewhere, no consistent 
pattern of results is found in math. 
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Average Fall-to-Spring VSS Gain for CE Students by 
Geographic Region and Criteria for Gain 



Geographic 
Region 



Sample 
Size 



Fall-to-Spring 
vss Gain 



Mean 



S.D. 



80% Credibility 
Interval 



Criteria for Gain* 



Lower 
Limit 



Upper Percentile Deflated 
Limit Maintenance Growth 



Reading 



Northeast ' 


1,400 


59. 


23 


35.49 


.95 


58 


.01 


60.44 


60 


63 


61 


50 


Ncrth Central 


718 


51. 


52 


31 .63 


i ip 


50 


01 


53.03 


60 


63 


61 


50 


Northwest 


369 


50. 


78 


35.21 


1.83 


48 


43 


53.13 


<. 60 


63 


61 


50 


South 


1,859 


62. 


52 


35.98 


.83 


61 


.45 


63.58 


57 


66 


56 


50 


Northeast 


1 , 628 


44 . 


09 


34.20 


.85 


43 


00 


45.17 


42 


42 


42 


35 


North Central 


857 


43. 


73 


34.55 


1.18 


42 


22 


45.24 


43 


41 


40 


35 


Northwest 


309 


43. 


44 


37.45 


2.13 


40 


72 


46.17 


43 


43 


42 


35 


South 


1,894 


41. 


39 


36.84 


.85 


40 


.31 


42.48 


42 


43 


42 


35 


Northeast 


1 510 


31. 


91 


31.95 


.82 


30 


. 86 


32 . 97 


36 


36 


36 


26 


North Central 


734 


35. 


47 


30.43 


1.12 


34 


.04 


36.91 


35 


34 


34 


26 


Northwest 


255 


41. 


64 


38.32 


2.40 


38 


57 


44.71 


34 


34 


34 


26 


South 


2,036 


34. 


68 


34.76 


.77 


33 


69 


35.66 


32 


34 


34 


26 


Northeast 


1,303 


30. 


52 


34.46 


.95 


29 


30 


31.74 


32 


26 


32 


22 


North Central 


663 


28. 


34 


34.87 


1.35 


26 


60 


30.07 


34 


26 


32 


22 


Northwest 


224 


27. 


19 


40.90 


2.73 


23 


69 


30.69 


34 


26 


35 


22 


South 


1,685 


31. 


53 


40.19 


.93 


30 


.27 


32.78 


31 


31 


31 


22 


Northeast 


1,294 


23. 


94 


34.99 


.97 


22 


.70 


25.19 


26 


26 


29 


20 


North Central 


650 


27. 


78 


33.62 


1.32 


26 


10 


29.47 


27 


26 


29 


20 


Northwest 


145 


21. 


64 


40.45 


3.36 


17 


31 


25.97 


23 


25 


25 


20 


South 


1,527 


25. 


84 


35.93 


.92 


24 


66 


27.02 


29 


26 


3* 


20 


Northeast 


1,066 


27. 


19 


34.97 


1.07 


25 


.82 


28.57 


29 


25 


31 


20 


North Central 


715 


24. 


34 


30.19 


1.13 


22 


89 


25.78 


30 


25 


31 


20 


Northwest 


134 


26. 


13 


35.35 


3.05 


22 


20 


30.07 


29 


22 


27 


20 


South 


1,592 


24. 


49 


38.44 


.96 


23 


25 


25.72 


32 


25 


31 


20 



Math 



Northeast 


695 


64. IS 


36.30 


1.38 


62 


42 


65 


94 


59 


61 


58 


47 


North Central 


445 


55.93 


33.96 


1.61 


53. 


87 


57 


99 


55 


61 


58 


47 


Northwest 


223 


47.03 


37.70 


2.52 


43. 


80 


50 


.26 


57 


61 


58 


47 


South 


1,419 


61.91 


37.43 


.99 


60 


64 


63 


19 


56 


62 


54 


47 


Northeast 


692 


56.24 


41.74 


1.59 


54 


21 


S8 


27 


57 


59 


54 


42 


North Central 


573 


55.32 


38.86 


1.62 


53. 


24 


57 


.40 


54 


59 


54 


42 


Northwest 


154 


48.47 


39.77 


3.20 


44 


37 


52 


.57 


53 


57 


52 


42 


South 


1,366 


52.32 


38.68 


1.05 


50 


98 


53 


66 


53 


57 


52 


42 


Northeast 


739 


60.05 


42.01 


1.55 


58. 


07 


62 


03 


59 


62 


57 


43 


North Central 


569 


58.20 


39.49 


1.66 


56 


08 


60 


32 


58 


62 


57 


43 


Northwest 


132 


,,1.47 


46.31 


4.03 


56 


27 


66 


67 


58 


62 


57 


43 


South 


1,490 


46.30 


42.67 


1.11 


44. 


89 


47 


72 


58 


62 


57 


43 


Northeast 


711 


45.94 


42.37 


1.59 


43. 


91 


47 


97 


50 


53 


49 


46 


North Central 


545 


51.33 


41.30 


1.77 


49. 


07 


53 


60 


52 


56 


54 


46 


Northwest 


146 


57.79 


,48.55 


4.02 


52. 


61 


62 


97 


48 


53 


49 


46 


South - 


1/250 


46.68 


*45. 65 


1.29 


45. 


03 


48 


34 


45 


55 


45 


46 


Northeast 


" 614 


42.12 


47.04 


1.90 


39. 


69 


44 


55 


41 


45 


40 


29 


North Central 


564 


45.59 


43.74 


1.84 , 


43. 


23 


47 


94 


42 


45 


40 


29 


Northwest 


132 


53.80 


43.69 


3.80 


48. 


89 


58 


70 


38 


45 


40 


29 


South 


1,189 


38.26 


44.02 


1.28 


36. 


63 


39 


90 


41 


45 


40 


29 


Northeast 


595 


39.14 


45.87 


1.88 ' 


36. 


74 


41 


55 


38 


42 


41 


39 


North Central 


568 


41.52 


43.79 


1.84 


39. 


"17 


43 


87 


41 


42 


41 


39 


Northwest 


112 


38.32 


41.68 


3.94 


33. 


24 


43 


40 


43 


44 


42 


39 


South 


1,174 


41.66 


48.58 


1.42 


39. 


83 


43 


48 


43 


42 


41 


39 



*Percentile Maintenance: VSS gain required to maintain a percentile rank associated with 
the mean fall VSS for the group. 
Deflated Growth: Three-fourths of ,the VSS gain required to maintain the 50th percentile 
rank. 
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Table Bl-3 



Average Fall-to-Spring VSS Gain for CE Students by 
School's Urbanism and Criteria for Gain 



G' 
Rl 
A 
D 
E 



School • s 
Urbanism** 



Sample 
Size 



Fall-to-Spring 
VSS Gain 



Mean 



S.D. 



S.E. 



80% Credibility 
Interval 

Lower Upper 
Limit Limit 



Criteria for Gain* 

Percentile Deflated 
Maintenance Growth 



City 

1 . Suburb 

Rural 

City 

2 Suburb 
Rural " 

City 

3 Suburb 
Rural 

City 

4 Suburb 
Rural 

City 

5 Suburb 
Rural 

City 

6 Suburb 
Rural 



Cxty 

Suburb 

Rural 

City 

Suburb 

Rural 

City 

Suburb 

Rural 

City 

Suburb 

Rural 

City 

Suburb 

Rural 

Cicy 

Suburb 

Rural 











Reading 


















2,237 


60. 


70 


35.44 


.75 


59. 


74 


61.66 


57 


66 


56 


50 


1,114 


56. 


07 


37.11 


1.11 


54. 


65 


57. 


49 


54 


66 


56- 


50 


995 


56. 


90 


32 .76 


1 . 04 


55 . 


57 


58.22 




D J 


61 


50 


2,240 


41. 


27 


36.34 


.77 


40. 


29 


42.26 


42 


43 


42 


35 


1,418 


43. 


26 


34.91 


.93 


42. 


08 


44. 


45 


41 


41 


40 


35 


1 , U JU 


A^ 


Qn 
7U 




l ■ uo 


44 


52 


47. 


28 


41 


41 


40 


35 


1 IOC 




J? 




• O 7 


33 . 


5 1 


35. 


26 


32 


34 


35 


26 


1,236 


33. 


98 


35.15 


1.00 


32. 


70 


35 


26 


35 


34 


35 


26 


974 


34. 


40 


32. 19 


1.03 


33. 


08 


35. 


72 


37 


38 


38 


26 


1,827 


29. 


95 


38.35 


.90 


28. 


80 


31. 


10 


30 


31 


31 


22 


1 , 136 


31. 


10 


JO. Dh 


l 14 

1 • 1H 


29 , 


63 


32. 


56 


33 


28 


35 


22 


912 


30 


39 


tA A') 


1 1 A 




CXA 


31. 


85 


31 


26 


35 


22 


1,744 


25 


34 


35.11 


.84 


24 


27 


2fc. 


42 


28 


27 


27 


20 


1 ,064 


22 


83 


35.47 


1 . 09 


21 


44 


24 


22 


29 


26 


29 


20 


808 


28 


65 


35. 73 


1.26 


27 


.04 


30 


26 


24 


25 


25 


20 


1,633 


25 


30 


37.34 


.92 


24 


. 11 


26 


48 


OQ 


29 


Z 1 


on 


i nm 


26 


.80 


35. 09 


1.11 


25 


, 39 


28 


22 


30 


25 


31 


20 


oo / 


23 


.74 


33 .26 


1.13 


22 


. 29 


25 


.18 


29 


22 


27 


20 










Math 


















1,589 


62.04 


37.20 


.93 


60 


.85 


63 


.24 


57 


62 


54 


47 


552 


59 


.04 


38.82 


1.65 


56 


.93 


61 


.16 


53 


62 


54 


47 


641 


57 


.19 


34.25 


1 . 35 


cc 
bb 


Ad 
. HO 


58 


.92 


ou 


Al 


59 


47 


1,591 


54 


.65 


41.46 


1.04 


53 


. 32 


55.98 " 


53 


57 


52 


42 


521 


52.98 


40.10 


1.76 


50 


.73 


55 


.22 


54 


59 


54 


42 


673 


51.99 


34.32 


1.32 


50 


.30 


53 


.69 


56 


61 


54 


42 


1,641 


50 


.53 


41.33 


1.02 


49 


.28 


51 


.89 


59 


62 


57 


43 


617 


52 


.23 


45.21 


1.82 


49 


.90 


54 


.56 


58 


62 


57 


43 


672 


58 


.58 


42.57 


1.64 


56 


.48 


60 


.69 


59 


62 


57 


43 


1,297 


49 


.14 


43.98 


1.22 


47 


.57 


50.70 


45 


55 


45 


46 


684 


42 


.35 


45.38 


1.74 


40 


.13 


44 


.57 


51 


53 


. 49 


46 


671 


51 


.76 


42.77 


1.65 


49 


.65 


53 


.88 


51 


56-. 


52 


46 


1,317 


41 


.52 


45.86 


1.26 


39 


.90 


43 


.13 


39 


49 


38 


29 


571 


36 


.66 


43.98 


1.84 


34 


.30 


39 


.01 


40 


49 


38 


29 


611 


46 


.74 


43.00 


1.74 


44 


.51 


48.97 


44 


49 


42 


29 


1,145 


41.96 


47.80 


1.41 


40 


.15 


43 


.77 


44 


42 


41 


39 


625 


36.62 


45.42 


1.82 


34 


.30 


38.95 


41 


44 


42 


39 


679 


42.92 


45.20 


1.73 •> 


40 


.70 


45 


.14 


42 


43 


45 


39 



*Percentile Maintenance: VSS gain required to maintain a percentile rank associated with 

the mean fall VSS for the group. 
Deflated Growth: Three-fourths of the VSS gain required to maintain the 50th percentile 
rank . 

**City — city over 50,000; Suburb — suburb of city or city under 50,000; and rural — rural 
area near or not near a city. 
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Table Bl-4 



Average Fall-to-Spring VSS Gain for CE Students by School's Concentrations of 
£ Minority Enrollments and Free-Meal Participants and Criteria for Gain 



G 
R 
A 
D 
E 


Concentrations of 
Minorities and Free- 
Meal Participants 


Sample 
Size 


Fall-to-Spring 
VSS Gain 


80% 


Credibility 
Interval 


Criteria 


for Gain* 


Mean 


S.D. 


S.E. 


Lower 
Limit 


Upper 
Limit 


Percentile Def late< 
Maintenance Growth 










Reading 




















High/High 


2,770 


60.47 


35.26 


.^7 


59.61 


61.33 


57 


66 


56 


50 




Hign/Low 


204 


56 . 38 


37 . 35 


2.62 


53.03 


59.72 


64 


63 


61 


50 


1 


Low/Hxgn 




50.37 


34.53 


2.10 


47 


.68 


53.05 


57 


66 


56 


50 




Low/Low 


1 101 


56.50 


34.97 


1.05 


55 


.15 


57.85 


62 


64 


61 


50 




High/High 


2 ,692 


40.99 


35.77 


.69 


40 


.11 


41.88 


43 


43 


42 


35 




High/Low 


391 


44.83 


36 .20 


1.83 


42 


.49 


47 . 17 


41 


41 


40 


35 


2 


Low/High 


441 


40.53 


37.31 


1.78 


38 


.25 


42.80 


41 


43 


42 






Low/Low 


1 , 164 


47.53 


33.78 


.99 


46 


.26 


48.80 


41 


42 


42 


35 




High/High 


2,873 


34.27 


32.86 


.61 


33 


.49 


35.06 


33 


34 


34 


26 




High /Low 


320 


30 .05 


32 .63 


1.82 


27 


.72 


_ 32.39 


41 


39 


41 


" 26 


3 


Low/High 


326 


32.64 


34.32 


1.90 


30 


.21 


35.07 


31 


34 


34 


26 




Low/Low 


1 ,016 


36.15 


34.95 


1.10 


34 


.75 


37.55 


43 


39 


41 


26 




High/High 


2,303 


30.73 


39.68 


.83 


29.67 


31.78 


32 


31 


31 


22> 




High/ Low 


247 


31.85 


37.78 


2.40 


28 


.78 


34.93 


33 


31 


31 


22 


4 


Low/High 


307 


28.93 


35.21 


2.01 


26 


.36 


31.50 


33 


28 


35 


22 




Low/Low' 




29.72 


32.80 


1.03 


28 


.40 


31.04 


33 


26 


35 


22 




High /High 


2,303 


24.96 


35.24 


.73 


24.02 


25.90 


29 


27 


27 


20 




U» nk /T/vj 

nign/ l-ctw 


204 


.25.59 . 


36.04 


2.52 


22 


.36 


28.82 


26 


26 


29 


20 


5 


Low/High 


280 


. 28.58* 


37.89 


2.26 


25.68 


31.47 


27 


27 


27 


20 




Low/Low 


829 


25.25 


34.83 - 


1.21 


23 


.70 


26.80 


26 


25 


25 


20 




High/High 


2 ,148 


25.65 


37 . 39 


.81 


24 


.62 


26.68 


29 


29 


27 


20 






244 


23.57 


32.45 


2.08 


20.91 


26 .23 


28 


25 


31 


20 


6 


Lov/High 


234 


22.72 


36.04 


2.36 


19 


.70 


25.73 


28 


29 


27 


20 




Low/Low 


881 


25.79 


32.22 


1.09 


24 


40 


27.18 


27 


21 


27 


20 










Math 








- 












High/High 


2,074 


61. 84 


17.33 


.82 


60 


.79 


62.89 


57 


62 


54 


47 






121 


60.08 


37 . 36 


3.40 


55 


.71 


64.46 


61 


63 


59 


47 


1 


Low/til yfl 


84 


59.55 


28.88 


3.15 


55 


.48 


63.61 


55 


62 


54 


47 




Low/Low 


503 


54.30 


35.77 


1.59 


52 


26 


56.35 


65 


64 


61 


47 




High/High 


1 ,975 


53. 35 


s 63 


.91 


52 


.18 


54.52 


52 


57 


52 


42 




nxgn/irfow 


222 


56.70 


3b .66 


2.46 


53 


55 


59.85 


54 


61 


54 


42 


2 


low/ Mign 


198 


43.15 


36.55 


2.60 


39 


.82 


46.47 


55 


61 


54 


42 




Low/ Low 


390 


59.11 


36.20 


1.83 


56 


.76 


61.46 


53 


61 


54 


42 




High/High 


2,189 


49.91 


41.88 


.90 


48 


76 


51.05 


57 


62 


57 


43 


3 


High/Low 


145 


53.52 


40.22 


3.34 


49 


.21 


57.82 


CO 




57 






Low/Hign 


137 


52 .58 


44.09 


3.77 


47 


72 


57.45 


59 


63 


57 


43 




Low/Low 


459 


66 . 20 


43.65 


2 .04 


63 


59 


68.81 


57 


62 


57 


43 




High/High 


1,784 


48.16 


44.48 


1.05 


46 


81 


49.51 


44 


55 


45 


46 




High/ Low 


157 


42.22 


42.64 


3.40 


37 


86 


46.57 


51 


54 


51 


46 


4 


Low/High 


127 


50.96 


37.70 


3.35 


46 


65 


55.27 


45 


55 


45 


46 




Low/Low 


584 


48.66 


44.89 


1.86 


46 


28 


51.04 


55 


58 


56 


46 




High/High 


1,696 


39.96 


44.45 


1.08 


38 


58 


41.34 


40 


49 


38 


29 


5 


High/Low 


117 


41.58 


47.86 


4.42 


35 


88 


47.28 


39 


52 


36 


29 




Low/High 


178 


44.36 


48.23 


3.62 


39 


73 


48.99 


40 


49 


38 


29 




Low/Low 


508 


46.52 


44.05 


1.95 


44.02 


49.02 


43 


49 


42 


29 




High /High 


1,550 


40.99 


47.51 


1.21 


39 


45 


42.54 


41 


42 


41 


39 




High/ Low 


135 


45.02 


44.12 


3.80 


40 


12 


49.92 


38 


47 


39 


39 


6 


Low/High 


188 


39.74 


47.87 


3.49 


35 


27 


44.21 


41 


42 


41 


39 




Low/Low 


576 


39.91 


43.98 


1.83 


37 


57 


42.26 


47 


43 


45 


39 



•percentile Maintenance: VSS gain required to maintain a percentile rank associated with 

the mean fall VSS for the group. 
Deflated Growth: Three-fourths of the VSS gain required to maintain the 50th percentile 
rank. 
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* Table Bl-5 

Average Fall-to-Spring VSS Gain for CE Students by School *s Concentration of 
Low-Achieving Students and Criteria for Gain 



G 

R . Concentration of 

A Low- Achievers in 

D Subject Area 
E 



Sample 
Size 



Fall-to-spring 
VSS Gain 



Mean 



S.D. 



S.E. 



Low 

Medium 
High 

Low 

Medium 
High 



Heading 



Low 


810 


57. 


07 


36. 


71 


1 . 




55. 


4 2 


58. 


73 


67 


65 


65 


50 


Medium 


1 044 


53. 


79 


33. 


17 


1. 


03 


52. 


47 


55. 


10 


59 


65 


59 


50 


High^ 


2,492 


61. 


19 


35. 


54 




71 


60. 


27 


62. 


10 


50 


68 


53 


50 


Low 


934 


44. 


64 


35. 


17 


1. 


15 


43. 


17 


46. 


11 


42 


44 


43 


35 


Medium 


1,288 


45. 


03 


33. 


38 


* 


93 


43 . 






CC 


4 1 


41 


40 


35 


High 


2,466 


41. 


11 


36. 


74 




74 


40. 


17 


42. 


C6 


44 


43 


41 


35 


Low 


802 


35. 


57 


35. 


36 


i . 




33 . 


97 


37 . 


17 


40 


39 


33 


26 


ncuiutii 


987 


32 . 


68 


32. 


11 


1 

i . 




31 . 


37 


33. 


98 


36 


36 


36 


26 


High 


2,746 


34. 


47 


33. 


34 




64 


33. 


66 


35. 


29 


29 


32 


27 


26 


Low 


732 


C^3 . 


CO 


33. 


21 


1 1 


23 


28. 


01 


31. 


16 


32 


26 


31 


22 


Ma i nm 


865 


29 . 


Q1 

yi 


35. 


98 


1 1 


22 


28. 


34 


31. 


48 


34 


26 


32 


22 


High 


2,278 


30. 


83 


39. 


35 




32 


29. 


78 


31. 


89 


31 


31 


31 


22 


Low 


661 


26. 


68 


32. 


84 


1 


28 


25. 


C c 


28. 


32 


25 


27 


25 


20 


Medium 


848 




"b 


38. 


22 


1 


31 


23. 


29 


26. 


64 


26 


26 


29 


20 


High 


2,107 


25 


07 


35 


01 




.76 


24. 


10 


26 


05 


27 


27 


27 


20 


Low 


741 


25 


91 


28 


44 


■j 


. U*i 


24 


57 


27 


25 


28 


21 


26 


20 


Medium 


676 


23 


67 


36 


08 


i 
l 


TO 
. J V 


21 


. 90 


25 


45 


27 


29 


27 


20 


High 


2,090 


25 


.68 


37 


87 




.83 


24 


62 


26 


74 


30 


29 


27 


20 










Math 






















Low 


450 


60 


.83 


36 


.63 


1 


.73 


58 


.62 


63 


.04 


63 


64 


61 


47 


Medium 


664 


50 


.57 


32 


.31 


1 


.25 


48 


.96 


52 


.17 


59 


61 


68 


47 


High 


1,668 


64 


.08 


38 


.02 




.93 


62 


.89 


65 


.27 


58 


62 


57 


47 


Low 


461 


56 


.14 


38 


.78 


1 


.81 


53 


.83 


b8 


.46 


58 


58 


55 


42 


Medium 


745 


50 


.26 


37 


.69 


1 


.38 


48 


.49 


52 


.02 


54 


59 


54 


42 


High 


1,579 


54 


.61 


40 


.61 


1 


.02 


53 


.30 


55 


.91 


50 


61 


49 


42 


Low 


517 


70 


.35 


41 


.39 


1 


.82 


68 


.02 


72 


.58 


58 


63 


57 


43 


Medium 


669- 


47 


.97 


41 


.37 


1 


.60 


45 


.92 


50 


.01 


59 


62 


57 


43 


High 


1,744 


49 


.39 


42 


.07 


1 


.01 


48 


.10 


50 


.68 


59 


62 


57 


43 


Low 


548 


46 


.10 


44 


.69 


1 


.91 


43 


.65 


48 


.54 


61 


58 


59 


46 


Medium 


657 


46 


.31 


41 


.27 


1 


.61 


44 


.25 


48 


.37 


49 


53 


49 


46 


High 


1,447 


49 


.58 


45 


.21 


1 


. 19 


48 


.06 


51 


.10 


49 


55 


45 


46 



475 
555 
1,469 

571 
503 
1,375 



46.51 
42.15 
39.95 

37.19 
41.74 
42.07 



42.43 1.95 

48.60 2.06 

44.07 1.15 

43.41 1.82 

45.81 2.04 

47.99 1.29 



80% Credibility 
Interval 



Lower Upper 
Limit Limit 



Criteria for Gain* 

Percentile Deflated 
Maintenance Growth 



44.02 
39.51 
38.48 

34.87 
39.13 
40.41 



49.00 
44.79 
41.42 

39.52 
44.36 
43.72 



42 
41 
39 

44 
37 
41 



49 
45 
49 

43 
47 
42 



42 29 

40 29 

38 29 

42 39 

39 39 

41 39 



^Percentile Maintenance: VSS gain required to maintain a percentile rank associated with 

the mean fall VSS for the group. 
Deflated Growth: Three-fourths of the VSS gain required to maintain the 50th percentile 
rank . 
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Table Bl-6 



Average Fall-to-Spring VSS Gain for CE Students by Category 
of Regular and CE Expenditures and Criteria for Gain 



G 
R 
A 
D 
E 


Expenditures for 
Regular Education 
and CE 


Sample 
Size 


Fall-to-Spring 
VSS Gain 


80% Credibility 
Interval 


Criteria 


for Gain 


* 


Mean 


S.D 




S. 


E. 


Upper 
Limit 


Lower 
Limit 


Percentile 
Maintenance 


Deflated 
Growth 






• 




Reading 






















Low Regular/Low CE 


1,608 


57.51 


36.37 




89 


56.38 


58.64 


57 


66 


56 


50 


1 


Low Regular/High CE 


623 


60.85 


32. 


66 


1. 


31 


59.18 


62 . 


53 


56 


66 


56 


50 




High Regular/Low CE 


1,146 


60. 25 


34.58 


1.02 


58.94 


61. 


56 


59 


63 


61 


50 




High Regular /High CE 


889 


57.17 


3,6. 


05 


1. 


21 


55.62 


58. 


71 


54 


66 


56 


50 




Low Regular/Low CE 


1,632 


40.96 


36. 


99 


• 


92 


39.79 


42. 


14 


43 


43 


42 


35 


2 


Low Regular/High CE 


893 


40 . 87 


34. 


76 


1. 


16 


jy . jo 


42. 


36 


42 


43 


42 


35 




High Regular/Low CE 


1«193 


46.49 


34. 


91 


1. 


01 


45.20 


47.79 


39 


41 


40 


35 




Hign Regular/ nign ce 


a"7n 
y /u 


43.57 


34 . 


30 


\ m 


10 


« 42.16 


.44.99 


40 


41 


40 


35 




Low Regular/Low CE 


1,747 


32. 97 


35. 


51 




85 


31 . 88 


34. 


06 


35 


36 


36 


26 




■ Low Regular/High CE 


876 


35.8* 


31. 


Q£ 


1. 


05 


34.50 


37. 


18 


29 


32 


27 


26 


3 


High Regular/Low CE 


1,013 


33.21 


31. 


66 




99 


31.94 


34.49 


36 


38 


38 


26 




Hi ah Rpcrular /Hi ah CE 


899 


36.49 


33. 


45 


1 


12 


35.06 


37.92 


35 


34 


34 


26 




Low Regular/Low CE 


1,427 


29.19 


38. 


32 


1. 


01 


> 27.89 


30. 


49 ** 


35 


26 


'32 


22 




Low Regular/High CE 


8}4 


29.30 


36. 


53 




28 


27.66 


30. 


94 


32 


31 


31 


22 


4 


Ui nh Da en ilsr / T /\u C F 


954 




36 


62 


1. 


19 


30 . 00 


33 


04 


33 


26 


32 


22 




t-Ii'rfh pomil AT* /H i oh fr 


680 


32.63 


38. 


11 


1. 


46 


30.75 


34 


so 


34 


26 


32 


22 




Low Regular/Low CE 


1,308 


£H . 1 £. 


35. 


26 




98 


23 48 


25. 


97 


27 


26 


29 


20 




Low Regular/High CE 


681 


Z J . 1U 


35. 


50 


1 . 


36 


21 . 36 


24 


84 


27 


27 


27 


20 


5 


High Regular/Low CE 


1 066 


25 . 32 


35 


58 


1 


09 


23 . 92 


26 


71 


27 


25 


25 


20 




High Regular/High CE 


561 


29.55 


35 


02 


i 
i 


48 


27.66 


31 


45 


26 


26 


29 


20 




Low Regular/Low CE 


1,391 


23.75 


36 


89 




99 


22.49 


25 


02 


31 


25 


31 


20 




T jyu Pomi 1 af /H i ah PF 


668 


24 . 46 


37 


61 


1 


46 


22 . 59 


26 


32 


- 25 


29 


27 


20 


6 


High Regular/Low CE 


966 


24.87 


32 


75 


1 


05 ■ 


23.52 


26 


22 


. 30 


22 


27 


20 




High Regular/High CE 


482 


32.11 


34 


71 


1 


58 


30.08 


34 


13 


\ 28 


29 


27 


20 










Math 






















Low Regular/Low CE 


1,188 


59.43 


36.44 


1 


06 


50.08 


60 


78 


56 


62 


54 


47 




Low Regular/High CE 


311 


56. 13 


34 


97 


1 


.98 


53. 59 


58 


.67 


55 


62 


54 


47 


1 


High Regular/Low CE 


1,002 


63. 08 


38 


83 


1 


23 


61. 51 


64 


65 


57 


61 


58 


47 




High Regular/High CE 


281 


58. 98 


33 


3? 


1 


99 


56.44 


61 


53 


57 


62 


54 


47 




Low Regular/Low CE 


1, 252 


49.00 


38 


.26 


1 


03 


47.61 


50 


38 


57 


59 


54 


42 




Low Regular/High CE 


308 


53.94 


38 


.80 


2 


21 


51 . 11 


56 


.76 


51 


61 


49 


42 


2 


High Regular/Low CE 


931 


59. 20 


40.03 


1 


31 


57 . 52 


60 


88 


55 


59 


54 


42 




High Regular/High CE 


294 


56. 03 


42 


.27 


2 


4. 


52.87 


59 


.19 


53 


57 


52 


42 




Low Regular/Low CE 


1,27 5 


45.31 


43 


.23 


1 


.21 


43.76 


46 


.86 


59 


62 


57 


43 




Low Regular/High CE 


4 26 


59.87 


44 


.07 


2 


.14 


57 . 14 


62 


.60 


57 


63 


57 


43 


3 


High Regular/Low CE 


868 


55.76 


40 


.17 


1 


.36 


54.01 


57 


^0 


57 


62 


57 


43 




High Regular/High CE 


TCI 


63. 52 


39-. 46 


2 


.08 


60. 86 


66 


.17 


59 


63 


57 


43 




Low Regular/Low CE 


1,188 


43.91 


45 


.24 


1.31 


42.23 


45 


.59 


49 


54 


51 


46 




Low Regular/High CE 


379 


47.59 


39 


.74 


2 


04 


44.98 


50.21 


46 


55 


45 


46 


4 


High Regular/Low CE 


731 


50.69 


43 


.97 


1 


.63 


48.61 


52.77 


54 


59 


53 


46 




High Regular/High CE 


354 


56.97 


43 


.94 


2 


.34 


53.98 


59.96 


49 


55 


45 


46 




Low Regular/Low CE 


1,060. 


35.53 


44 


.47 


1 


.37 


33.78 


37 


.20 


41 


45 


40 


29 




Low Regular/High CE 


365 


44.68 


43 


.90 


2,30 


41.74 


47.63 


38 


49 


38 


29 


5 


High Regular/Low CE 


764 


45.47 


43 


.16 


1 


.56 


43.47 


47 


.47 


40 


45 


40 


29 




High Regular/High CE 


310 


49.84 


48 


.78 


,2 


.77 


46.30 


33 


.39 


36 


52 


36 

*> 


29 




Low Regular/Low CE c 


1,077 


30.60 


46 


.95 


1 


.43 


36.77 


40 


.43 


42 


42 


41 


39 




Low Regular/High CE 


322 


45.12 


49.75 


2.77 


41.57 


48 


.67 


37 


47 


39 


39 


6 


High Regular/Low CE 


762 


41.61 


45 


.20 


1 


.64 


39.51 


43 


.70 


42 


43 


45 


39 




High Regular/High CE 


288 


42.60 


44.47 


2 


.62 


39.25 


45 


.96 


37 


47 


39 


39 



•Percentile Maintenance: VSS gain required to maintain a percentile rank associated with 

the mean fall VSS for the group. 

Deflated Growth: Three-fourths of the VSS gain require** ^ maintain the 50th percentile 
rank. 
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In light of these results, there is a small encouraging sign that points to 
some relationship between effects of CE and the level of expenditures. How- 
ever, this finding should not be overemphasized unless it can be replicatfed 
in later years (the* reader may recall that a similar finding in the first year 
of the ESAA study was not * replicated in the subsequent study years) . 

On the whole, jnost of these subset ^aiyses have not hel P ed us to 9*in a m 
better understanding of the effects of CE. 

| 

Norm-Referenced Criteria Applied to Individual Students 

In this section we present the results of some additional norm-referenced 
analyses that implement the percentile-maintenance criterion on an individual 
basis. Essentially, this set of analyses examines CE students' achievement 
gains in terms of the z-scores (standardized normal deviates) associated with 
their pretest and posttest percentile scores. The assumption underlying these 
analyses stipulates that without CE intervention, the students will achieve 
z-score gains of zero because they will maintain constant percentile ranks. 
Under this expectation, effectiveness of CE is demonstrated by a positive mean 
gain in z-scores for the CE students. Accordingly, we performed simple t-tests 
on the mean z-score gains in order to evaluate the effects of CE. Table Bl-7 * 
presents these statistical tests by grade for reading and math. 

In reading, the tests show significant positive effects of CE in grades 2 and 
3, but not in grade 1. The finding in grade 1 contradicts that in the earlier 
group-level analysis, snowing a negative average z-score gain, whereas the pre- 
vious analysis shows tha't the average VSS gain for the CE students exceeds the 
criterion derived on the group basis. On the other hand, the significance of 
the positive mean z-score gain in grade 3 provides stronger evidence for the 
effectiveness of CE than does the analysis based on group-level implementation 
of the same criterion. Jn math, implementation of the criterion at the indivi- 
dual level produced evidence for positive effects of CE in grades 1, 3, 5, and 
6. Again, the results do not agree completely with those obtained with the 
group-level analysis. An apparent discrepancy between the results of the two 
analyses is found in grade 3. 

Our confidence in the findings of the norm-referenced analyses is slightly 
lowered in light of the few discrepant results. One possible explanation is 
that the individual norms do not properly reflect group performance. Another 
conjecture is that the result is more sensitive to the floor effects of the 
achievement tests when the criterion is implemented on an individual basis 
than when it is implemented on the group level. Furthermore, direct applica- 
tion of the standard to individual performance amounts to a comparison with 
that of students in the general population whose characteristics and achieve- 
ment level differ considerably from those of the CE students. For this reason, 
the z-score gains of CE students are further examined in a later section of 
Chapter 2, where mean z-score gains will be compared among groups of CE stu- 
dents and non-CE students of similar characteristics. 
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, Table Bl-7 

Fall Achievement Status and Fall-to-Spring''Gain in Terms of 
Standardized Normal Deviate (z) Scores for All CE Students by Grade 





Pretest 


z Score 


i- all U \) 


-Lily uaxll 








Graded 






in z 


Score 










Mean 


S .D. 


Moan 

i 


q n 




u 








Reading 


— — r 

• 










1 


-•55 


.88 


-.02 


.82 


-1 


.39 




2 


-•69 


.84 


.02 


.66 


2 


.19 


* 


3 


-•80 


.83 


.05 


.57 


6 


.21 


** 


4 


-.83 


.78. 


.01 


.58 


1 


.34 




5 


^ -.84 


.77 


-.00 


.49 


- 


.49 




6 


-•87 


.78 


» 

• 01 ; 

t 


.46 


1 


.90 








Math 


1 










1 


-•47 


.96 


.06 


.87 


3 


.62 


** 


2 


-.57 


.96 


.02 


.78 


1 


.54 




* 


-.65 


.92 


.06 


.77 


4 


.08 


** 


4 


-.72 


.90 


- .01 


.66 




.67 




5 


-.73 


.88 


.04 


.62 


3 


.66 


** 




-.71 


.88 


.04 


.60 


2 


.93 


** 


^Sample sizes 


(N) for each grade can 


be obtained by summing the 


N's 


for 



the three groups of CE student^ in Table Bl-8. 
♦Significant at the .05 level. 
♦♦Significant at the .01 level. 
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' Table Bl-8 

Fall Achievement Status and Pall-to-Spring Gain in Terms of 
Standardized Normal Deviate (z), Scores, by Category of CE Students 



CE Category 



Title I Students 

Other-CE Students in Title I Schools 
CE Students in Other-CE Schools 

Title I Students « 
Other-CE Students in Title I Schools 
CE Students in Other-CE Schools 

Title I Students 

Other-CB Students in Title I Schools 
CE Students in Other-CE Schools 

Title I Students 

Other-CE Students in Title I Schools 
CE Students in Other-CE Schools 

Title I Students 

Other-CE Students in Title I Schools 
CE Students in Other-CE Schools. 

Title I Students 

Other-CE Students in Title I Schools 
CE Students ih Other-CE Schools 



Heading 



Pretest 
z Score 



Gain in z Score 



F** 







Mean 


Mean 


S.D. 




2, 


785 


■*-0.68 


0.01 


0.82 


0.93 




987 


-0.30 


—0 .05 


0 . 79 


-1.97 




574 


-0.34 


-0.16 


0.85 


-4.59 


3 


036 


-0.81 


0.03 


0.65 


2.43 




948 


-0.29 


-0.05 


0.64 


-2.33 




704 


-0.66 


0.08 


0.71 


3.07 


3 


,022 


-0.92 


0.07 


0.56 


6.88 




884 


-0.44 


0.00 


0.60 


0.24 




629 


-0.68 


0.04 


0.62 


1.63 


2 


,392 


-0.95 


0.03 


0.59 


2.14 




864 


-0.57 


-0.02 


0.55 


-1.01 




619 


-0.70 


0.00 


0.60 


0.20 


2 


,227 


-0.97 


-0.00 


0.49 


-0.30 




802 


-;-0.51 


-0.03 


0.46 


-1.81 




587 


-0.78 


0.D3 


0.53 


1.26 


1 


,982 


-1.01 


0.03 


0.47 


2.76 




905 


-0.56 


0.02 


0.43 


1.67 




620 


-0.90 


-0.05 


0.45 


-2.48 



11.92** 



8.53* 



4.57* 



1.93 



2.30 



6.48* 



Math 



Pretest 
z Score 



Gam in z score 



F** 





Mean 


Mean 


S .0. 


\ 




1 598 


-0.66 


0.12 


0.86 


5.64. 


12.36** 


855 


-0.22 


-0.06 


0.85 


-2.06 




329 


-0.25 


0.07 


0.90 


1.42 




1,686 


-0.77 


0.04 


0.79 


2.19 


1.60 


808 


-0.24 


-0.02 


0.76 


-0.66 




291 


-0.37 


0.02 


0.80 


0.51 




1,793 


-0.82 


0.13 


0.75 


7.60 


28.38** 


768 


-0.35 


-0.01 


0.80 


-0.41 




/» 369 


-0.43 


-0.17 


0.76 


-4.25 




1,434 


-0.93 


0.08 


0.63 


4.93 


35.50** 


845 


-0.44 


-0.03 


0.64 


-3.46 




373 


-0.56 


-0.21 


0.75 


-5.32 




1,331 


-0.91 


0.09 


0.61 


5.63 


11.02** 


768 


-0.40 


-0.04 


0.61 


-1.69 




400 


-0.76 


0.04 


0.66 


1.30 




1,134 


-0.83 


0.09 


0.61 


4.96 


9.05** 


858 


-0.47 


-0.01 


0.59 


-0.50 




457 


-0.84 


-0.02 


0.56 


-0.61 





Vtest of non-zero n*an gain for each group of CE students. Critical value for significance at .01 level is 2.33. 
'*Test of differences in z-score gains among the three groups of CE students is significant at .01 level. 
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Similar individual -level analyses employing the percent ile-maintenance crite- 
rion were also performed for the three categories of CE students. The results 
of these analyses are summarized in Tabie Bl-8. In addition to the t-tests on 
the mean z-score gains for each group, F-tests are obtained for the differerc^s 
among the groups. Inspection of the F-tests reveals considerable difference^ 
among the groups: positive effects are frequently shown for Title I students 
but not for other groups of CE students. The group differences in z-score 
gains are significant in grades 1, 2, 3, and 6 for reading and in all grades 
but grade 2 for math. 

In reading, significant improvement in z-sfcores during the school year is ob- 
tained in grades 2, 3, and 6 for Title I students, and in grade 2 for students 
in other-CE schools. In math, significant improvement is obtained for 'Title I 
students in all grades but grade 2. No other positive effects are evident for 
either reading or math CE. These findings are generally consistent with those 
in the previous group-level analyses with a single exception in grade 1, where 
the positive gain for Title I students is not significant. 

The last set of individual-level analyses for the percentile-maintenance cri- 
terion was performed for subsets of schools by demographic characteristics. 
As in the earlier* analyses, the findings did not consistently support differen- 
tial effects of CE by school characteristics. The results are presented in 
Tables Bl-9 through Bl-13. 

In summary, the findings from the implementation of the percentile-maintenance 
criterion on an individual basis tend to agree with the earlier findings on a 
group basis. 
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Table Bl-9 



Fall Achievement Status and Average Fall-to-Spring Gain for CE Students in Terms 
of Standardized Normal Deviate (z) Scor.es, by School's Geographic Region 



Grade 


Geographic 
Region 


Reading 


Math , 


Pretest 
z Score 


Gain in z Score 


* t* 


p** 


Pretest 
z Score 


Gain 


in z Score 


t* 






i Mean 


Mean 


S.D. 


Mean 


Mean 


S.D. 




Northeast 


-0.48 


-0.02 


0.81 


-0.95 


34.34** 


-0.42 


0.14 


0.84 


4.«42 


17.52** 


1 


North Central 


_A "I? 


-0.22 


0.73 


—P. z z 






—0, 07 


0. 79 


1 OA 

-l . yo 






Northwest 


_A AQ 

u * «*o 


-0.22 


0.82 


—5. 08 




a ic 


-0. 26 


0* 92 


A 11 

—4. 21 




* 


South , 




0. 09 


0*83 


A "7 O 

4 . / Z 




-0.58 


0\ 11 


0*88 


4. 77 






Northeast 


-0.52 


0*03 


0 .64 


1.63. 


0.91 


-0*55 


0.07 


0*84 


2.29 


2.30 


2 


North Central 


\j . / j 


0.05 


0.65 


Z . ID 




a /o 


A AZ 


A "7Q 
U. /o 


1 «b / 






Northwest 


-0.82 


0.03 


0*72 


U . D Z 




A T1 

— U. /I 


A A/1 
— U . U4 


A OA 


A CI 






South 


—a 7Q 


0.00 


0.67 


A TO 

U . Z o 




A C 1 

—0. 61 


-0. 01 


0* 76 


—0.41 






Northeas.t 


-0.68 


0 . 01 


0*56 


0.^64 


6.44** 


-0.63 


0.15 


0*76 


5.24 


7.47*' 


3 


North Central 


—a tq 


0.05 


0.S4 


z , t>z 




-0, 54 


0* 10 


0. 73 


3. 13 






Northwest 


- J. /o 


0.15 < 


0.63 


3. 90 




A "7/1 

—0, /4 


0. 13 


0. 86 


1 T1 

1 . 71 


* 




South 




0. 07 


0. 59 


C* CO 




—0, 69 


-0, 01 


A "7Q 


_A 

— U . jU 


J 




Northeast 


-0.75 


0. 02 fe 


0. 53 


1.13 


0.60 


-0.63 


-0..05 




-2.00 


4. Bp* 


4 


North Central 


— n 7Q 

U . / O 


-0.01 


0.55 


*.A A A 

*"U , 4U 




A CO* 
— U . DO 


0.1/2 


A £ /I 

U« b4 


A OA 

U . o4 






Northwest 


— U . DA 


-0.01 * 


0,65 


_A "i yl 
— U . J 4 




-0,63 


A IT 
U . 1 / 


A "7/1 
U « / 4 „ 


1 "7/1 

J . /4 






South 


_ A CM 
— U . :?4 


0.02 


0.62 


1 /in 
1 . 4U 




-0.82 


-0. 02 


0. 68 


—1 . 14. j 






Northeast 


* 

r 0.82 


-0.02 


0^.48 


-1.63 


1.93 


-0,75 


0.05 


0.62 


/ 

1.93 


1.70 


5 


North Central 


-0.80 


" 0.02 


0.48 


0.82 




-0.60 


0.05 


0,63 


1.71 






Northwest 


-0.62* 


-0.06 


"0.55 


-1.3,8 




-0.70 


0.16 


0.63 


2.90 






South 1 z 


-0.89 


0.01 


0.50 


0.66 




. -0.78 


0.03 


0.62 


1.75 






Northeast 


-0.87 


0.03 


0.44 


2.29 


0.82 


-0.66 


o.do 


0*58 j 


i 0.17 


0.73 




m North Central 


-0.81 


-0.00 


0.40 


-0.01 




-0.69 


0.JD4 


0.58 


f 1.70 




6 


Northwest 


-0.7k 


0.03 


0.44 


0.76 




-0.90 


0.04 


6.52 


0.85 






South 


-0.91 


0.01 


0.49 


0.75 




-0.72 


0/05 


0.62 


.2.64 





w 

***t-test of non-zero mean gain for each region. Critical value for significance at .01 level ranges between 2.33 to 2.36, 
<iAt-u»nding on the degrees of freedom. " Sample sizes for each group can be found in Table Bl-2. 

of differences in z-score gains among regions is significant* at the .01 level. 
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School 1 s 
Urbanism 



City 

Suburb 

Rural 

City 

Suburb 

Rural 

City 

Suburb 

Rural 

City 

Suburb 

Rural 

City 

Suburb 

Rural 

> 

City 

Suburb 

Rural 



Table Bl-10 

Pall Achievement Status and Average Fall-to-Sprintf\Gain for afc students in Terms 
of Standardised Normal Deviate (z) Scores, Schqol/s Urbanism 



Reading 



Pretest 
z Score 

Mean 



Gain in z Score 



Mean 



S.D. 




-0,63 
-0.55 
-0.37 


0.04 
-0.07 
-0.10 


0.82 
0.84 
0.76 


2.09 
-2.82 
4.36 


-0.79 
-0.59 
-0.60 


-0.00 
0.02 . 
n nft 

\j . uo 


0.66 
0.66 

U . D3 


-0.13 
1.02 
3 . 74 


-0.89 ' 

-0.78 

-0.59 


0.07 
0.03 
0.05 


0.57 
0.60 
* 0.55 


5.64 
1.72 
2.85 


-0.92 
-0.87 
-0.57 


0.00 
0.02 
0.D2 


0.59 
0.59 
0.55 


0.24 
1.28 
1.01 


-0.93 
-0.89 
-0.57 


-0.00 
-0.03 
0.03 


0.48 
0.49 
0.51 


-0.11 
• -2.21 
1.57 


-0.96 
-0.92 
-0.66 


0.02 
0.04 
-0.02 


0.47 
0.45 
0.44 


1.29 
2.79 
-1.01 



4.84** 



1,74 



0.44 



3.62 



3.32 



Math 



^Prestest 
. z Score * 



>^ean 



Gain in z score 



t* F** 



Mean 



S.D, 



-0.59 
-0.5l\ 
-0.16 v 


0.12 
d.04 
-0.07 


0.86 
0.89 
0.84 


5.45 
1.11, 
-2. 10 


-0.69 ' 

-0.49 

-0.38 


0,05 
0,00 
\ -0,03 


• 0.80 
0.80 
0.71 

c 


2.58 
-0.10 
-0.92 


-0.70 
-0.62 
-0.54 


\ 0.08 
\0.01 
* 0.05 


0.77 
0.80 
0.75 


4*16 

0.22 
1.86 


-0.84 
-0.70 
-0.50 


0.01 
-0.08 
' 0.03 


0.65 
0.69 
0.66 


0,47 
-3.04 
1.22 


-0.84 
-0.78 
-0.44 


v 0.06* 
"S0.01 
0.06 


\ 0.64 
^0.59 
\0.62 


3.61 
-0.44 
2.41 


-0.75 . 

-0.82 

-0.53 


0.05 
-0.01 
0.05 


a. 6i 

0.58 
0.59 


2.89 
-0.33 
2.07 



2.67 



1.96 



3.05 



2.20 



t-test of non-zero mean gain for each category of urbanism. Critical value for significance at ,01 level is 2.33. 
Sample sizes for eacnXgroup can be found in Table Rl-3. 
** - \ 

Test of differences in »z -score gains among schools of different urbanism is significant at the ,01 level. 
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% Table Bl-11 

Fall Achievement Status and Average Fall-to- Spring Gain for CE Students in Terms of Standardized Normal 
Deviate (z) Scores , by School's Concentrations of Minority Students and Free-Meal Participants 



School's 
Concentrations 
of Minority 
Students and 

Free Meal 
Participants 



Reading 



Pretest 
z Score 

Mean 



Gain 'in z Score 



F** 



Mean 



S.D. 



Math 



Pretest 








z Score 


Gain in 


z Score 










t* 


Mean 


Mean 


S.D. 




-0.59 


0.11 


0.87 


5.91 


-0.31 


0.04 


0.82- 


0.50 


-0^49 


0.04 


0.71 


0.51 


-0.05 


-0.15 


0.86 


-3.92 










-0.65 


0.02 


0.80 


0.95 


-0.47' 


.0.08 


0.74 


ll59 


-0.46 


-0*18 


0.73 


-3.51 


-0.29 


0.12 


0.75 


3.27 


-0.71 


0*07 


0.78 


4.31 


-0.22 


-0.T8 


0.67 


-3.30 


-0.89 


0.06 


0.80 


0.90 


-0.42 


0.07 


0.76 


1.96 


-0.82 


-0.01 


0.66 


-0.67 


-6.84 


-0.04 


0.63 


-0.86 


-1.00 


0.10 


0.57 


1.95 


-0.30 


-0.02 


0.68 


-0.60 


-0.80 


O.04 


t 0.61 


2.89 


-0.93 


0.03 


0.68 


0.42 


-0.86 


0.09 


0.66 


1.78 


-0.39 


0.04 


0.63 


1.57 


-0.76 


0.04 


0)61 


2.73 


-0.94 


0.12 


0.54 


2.56 


-0.79 


0.04 


0.60 


0.89 


-0. M 


-0.00 


0.57 


-0.17 



High/High 
High/Low 
low/High 
Low/Low 

' High/High 
High/Low 
Low/High 
Low/ Low 

High/High 
High/Low 
Low/High 
* Low/Low 

High/High 
high/Low 
Low/High 
, Low/ Low 

JUgh/High 
High/Low 
Low/High 
Low/Low 

High/High 
High/Low 
Low/High 
Low/Low 



-0.68 
-0.42 
-I). 59 
-0.24 . 

-0.80 
-0.60 
-0.79 
-0.40 

-0.94 
-0.42 
-0.84 
-0.49 

-0.96 
-1.00 
-0.89 
-0.47 

-0.94 
-0.78 
-0.93 
-0.53 

-0.99 
-0.83 
-0.97 
-0.58 



0.04 
-0.08 
-0.19 
-0.13 

-0.01 
0.06 

-0.00 
0.08 

0.07 
-0.05 
0.03 
0.05 

0.01 
0.07 
-0.01 
0.02 

-0.00 
-0.00 
0.03 
-0.02 

0.02 
-0.01 
-0.01 

0.01 



0.82 
0.82 
0w81 
0.80 

o!65 
0.70 
0.68 
*0.66 

0.56 
0.55 
0.60 
0.60 

0.61 
0.60 
0.56 
0.52 



2.61 
-1.48 
-3.78 
-5.50 

-0.48 
1.62 

-0.15 
4.20 

6.65 
-1.62 
J>. 78 

2.47 

0.61 
1.87 
-0.28 
0.95 



0.49 -0.32 

0.53 -0.02 

0.51 1.05 

0.49 -1.12 

0.48 2.01 

0.43 -0.45 

0.47 -0.30 

0.42 1.01 



16.39** 



5.38* 



4.55** 



1.03 



0.77 



0.61 



12.69** 



7.17** 



4.98** 



1.31 



0.32 



1.77 



t-test of nor-zero mean gain for each category of concentrations. Critical value for significance at .01 level ranges 
^ n 2.33 and 2.36, depending on the degrees of freedom. Sample sizes for each group can be found in Table Bl-4. 

£j\L^ f differences in z-score gains among categories of concentrations is significant at the .01 level. <Q_j 
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Table Bl-12 0 * ' 

Fall Achievement Status and Average Fall-ta-Spring Gain for CE Students in .Terms of Standardized Normal 
„ Deviate (z) Scores, by Schools Concentration of* Reading/Math Low«;Achieving students 







t 


Reading 








Math 








VJ 


scnooi s 


















• 


R 


Concentration * 






















A 


of Reading/Math 


Pretest 


Gain in 


2 Score 






Pretest 


Gain in z 


Score 


• 




D 


Low- Achieving 


z Score 










2^ Score 






£ 


Students 








t* < 


F**. 








t* 






* Mean 


Mean 








Mean 


Mean 


S.D. 






.1 


Low 


* -0.0'5 


-0.15 


„ 0.82 


-5.02 


35.84** 


-0.01 


*-O.O0 


0.*84 


-0. 10 


39;oo** 


Medium 


-0.52 


-0.14 


0.78 


-5.94 




-0.42 


-o.u 


0.80 


-5.59- 






High 


m -0.73 


0.07 


0.82 


4.04 




-0£62. ' 


. 0.17 


0.88 . 


7.83 






Low 


-0.25 


0.02 


0.68 


' 0.80 


2.55 


-0.14 


0.05 


O.dl 


1.30 


5.23** 


2 


Medium 


-0.63 


0.06 


0.64 


3.11 




-0.50 


" -0.06 ' 


0.75 


-2.06 t 






High 


-0.88 


0.00 


0.66 


0.33 




-0.74 


0.05 


0.79 


2.65 * 






Low 


-0.26 


0.00 


0.60 


0.19 


5.52**' 


-0.24 


0.07 


0.73 


2.26 


2.20 


3 


Medium 


-0.70 


0.03 


0.56 


1.81 




-0,66 


0.00 


0.77 


0.11 . 






High 


-0.99 


0.07 


0.57 


6.86 


* 


-0.77 


0.07 


0.78 


3.99 






Low 


-0.30 


0.02 


0.53 


1.24 


0.18 


-0.22 


-0.06 


0.68 


-2 .'01 


2.72 


4 


Medium 


-0.82 


0.01 


0.56 


0.52 




-0.69 


-0.02 


0.63 


-0.89 






High 


-1.00 


O.Oi 


0.60 


u . / o 




u.yi 


U • UZ 


0 .67 


»0.93 






Low 


-0.38 


-0.01 


0.46 


-0.39 


0.13 


-0.29 


0.03 


0;60 


1.15 




5 


Medium 


-0.83 


-0.01 


0.54 


-0.55 




-0.76 


0.03 


0.68 


1.05 






High , 


-0.98 


-0.00 


0.48 


-0.06 




-0.86 


0.06 


0.61 


3.52 






Low 


-0.43 


0.02 


0.39 


1.08 


0.96 


-0.41 


-0.04 


0.57 


-1.68 


6.08** 


6 


Medium 


-0.94 - 


-0.01 


0.46 


-0.38 




-0.91 


0.07 


0*.57 


2.79 






High 


-1.01 


0.02 


0.48 


2.04 




-0.76 


0.05 


0.62 


3.21 




* 





t-test of non-zero mean gain for each category of concentration-. Critical 
Sample siz%s for each group can be found in Table Bl-5. 
** **«■ ^ 
Test of differences in 2 -score gains among different concentrations of low- 
.01 level. 



value for significance at level is 2.33. 
•achieving students is significant at the ' 
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Table Bl-13 

Fall Achievement Status* ,and Average. Fall-to-Spring Gain for CE Students in Terms of Standardized Normal 
Deviate (z) Scores, by Category of Expenditures for Regular and Compensatory Education 



G Category of 
^ R Expenditures 

A For Regular* and 

D - Compensatory 
E Education 



Low Reg/Low CE 
Low Reg/High CE 
High Reg/Low CE 
High Reg/High CE 



Low Reg/Low/ CE 
Low Reg/Hign CE 
High Reg /Low CE 
High Reg/High CE 

c ^ / 

Low Reg/lkw CE 
Low Reg/High CE 
High Reg/Low CE 
High Reg/High CE 

Low Reg/Low CE 
Low Reg/High CE 
High Reg/Low CE 
Higli Reg/High CE 



Low 
Low 



Reg/Low CE 
Reg/High Cft 
Aigh Reg/Low CE , 
High Reg/High CE 

Low Reg /Low CE 
Low Reg/High CE 
High Reg/Low CE 
Higii Reg/High CE 



Reading 



Pretest 

z-Score Gain in z Score 



Mean 



p** 



Mean 



S.D. 



-0.65 


-0. 


o* 


0.83 


-0.99 


2. 


42 


-0.70 


0. 


05 


0.76 


1.62 






-0.34 


-0. 


04 


0.80 


-1.67 






-0.54 


-0. 


06 


0,83 
* i 


-2.15 






-0 .74 


-0. 


or 


0.68 


-0.41 


3. 


24 


-0.79 


0. 


00 


0.63" 


0.04 






-0.54 


0. 


07 


0.67 


3.47 






-0.68 


0. 


03 


0.65 


1.47 






-0. 75 


*0. 


03 


0.60 


2.18 


3. 


35 


_i no 
1. U9 


0 . 


07 


0.53 


3.94 






-0.60 


0. 


03 


0.54"" 


2.02 






-0.82 


0. 


10 


0.59 


5.00 


r 




-0.81 


-0 


01 * 


0.59 


-0.61 


2 


89 


-1.08 


-0 


01 


0.57 


-0.50 






-0.65' 


0 


03 


0.57 


1.67 






-0.81 


0 


06 


0.59 


2.61 






-0.80 


-0 


.01 


0.49 


-0.85 


2 


.93 


-1.10 


-0 


.02 


0.49 


-1.30 






-0.71 


-0 


.01 • 


0.49* 


-0.73 






-0,85 


0 


.05 


0.50 


2.42 






-0.82 


-0 


.00 


0.48 


-0.21 


7 


.99*- 


-i:i6 


0 


.01 


0.47 


0.72 






-0;70 


-0 


.01 


0.43 


-0.4C 






-0.98 


0 


.11 


0.44 


5.4V 




i 



Math 



Pretest 

z Score Gain in z Score 



Mean 



Mean 



S.D. 



-0.59 


0.07 > 


0.85 


2.70 


-0.62 


-0.01 


0.82 


-0. 23 


-0.27 


0.08 


0.92 


2.59 


-0.58 


0 .'05 


0.78 


1.06 


-0.53 


-0 .08 


0.75 


-3.64 


-0.79 


0 .07 


0.77 


1.49 


-0.53 


0.12 


0.80 


4.68 




O.09 


0.82 


1.84 








-0.61 


-0.07 


0.78 


-3.13 


-0. 84 


0.20 


0.83 


4 . 99 


-(5.52 


0.09 


0.72 


3. 66 


-0.87 


0.26 


0.74 


6.72' 


-0.76 


-0.06 


0.68 


-3.11 


-0.89 


-0.01 


0.59 


-0.28 


-0.44 


0.00 


0.66 


0.08 


-0.95 


0.14 


' 0..67 


4.05 


-0.76 


-0.01 


0.62 


tO.26 


-0-81 , 


0.09 


0.59 


2.88 


-0.54 


0.05 


0.61 


2.27 


-0.97 


0.16 


0.66 


4.14 


-0.72- 


0.00 


* 0.60 


0.25 


-0.89 


0V11 


0.63 


3.06 


-0.52 


0.03 


0.59 


1.36 


-0.97 


0.09 


0.57 


2.57 



0.83 



13.05** 



25.57** 



8.95** 



6.22**,| 



t-test of non-zero mean gain for each category of expenditures. Critical value for significance at .01 level is 2.33. 
Sample sizes for each group can be found in Table Bl-6. 

O m of* differences in z-score gains among expenditure categories is significant at the .01 level. 
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APPENDIX ,B2 
SUPPLEMENTARY TABLES FOR ANALYSES OF VARIANCE 
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Table B2-1 

Two-Way ANOVA of Fall-to-spring Reading VSS Gain by CE Status and Initial Achievement Status 



G 


Initial 
Achievement 
Status 
(A) 








CE Status (B) 








R 
A 
D 

£ 




Title I 
Students in 
Title I Schools 


Other -CE 
Students in 
Title I Schools 


CE Students 
in Other-CE 
Schools 


Non-CE Students 
in Title I 
Schools 


Non-CE Student* 
in Other-CE 
Schools 


Students in 
Non-CE 
Schools 


TOTAL 












Reading Gain Score Means 








1 


Bottom 
One- Third 


H 
Mean 


917 
60.72 


240 
59.80 


159 
56.05 


1,080 
69.34 


376 
69.10 


461 
70.04 


3,233 
65.61 




Top 

TVo-Thi rds 


N 

Ke.m 


1,868 
58.49 


747 
59.53 


415 
53.46 


6,060 
^7.34 


2,862 
65.19 


1,690 
64.88 


13,642 
64.52 




TOTAL 


N 

Mean 


2,785 
59.23 


987 
59.59 


*574 
54.18 


7,140 
67.64 


3,238 
65. §4 


2,151 
^ 65.-99 


16,875 
64.73 


2 


Bottom 
Onc-Thii*d 


N 

Mean 


1,770 
45.20 


346 
43.05 


348 
51.04 


1,227 
43.19 


322 
51.41 


570 
44.07 


4,583 
45.24 




Top i 
Two-Thirds 


N 

Mean 


1,266 
39.15 


602 
40.31 


356 
40.99 


4,800 
43.22 


2,520 
42.39 


1,384 
41.37 


10,928 
42.09 


- 


TOTAL 


tt 
Mean 


3,036 
42.68 


948 
41.31 


704 
45.96 


6,027 
43.22 


2,842 
43.41 


1,954 
42.16 


15,511 
43.02 


3 


Bottom 
One-Third 


N • 

Mtv.n 


1,983 
37.29 


385 
35.30 


330 
38.24 


1,117 
36.02 


370 
40.35 


546 
37.21 


4,731 
37.13 




Top 

Two-Thirds 


U 

Mean 


1,039 
31.51 


499 
26.90 


299 
30.49 


4,860 
31.38 


2,557 
34.59 


1,392 
31.65 


10, 646 
31.97 




TOTAL 


M » 
Mean 


3,022 
35.31 


884 
30.56 


629 
34.55 


5,977 
32.25 


2,927 . 
35.32 


1,938 
"33.22 


15,377 
33.55 


4 


Bottom 
One-Third 


N 

Mean 


1,590 
34.62 


412 
29.77 


333 
32.25 


1,334 
35.38 


466 
36.59 


570 
36.14 


4,705 
34.62 




Top 

Two^ Thirds 


N 

Moan 


802 
24.89 


452 
27.28 


286 
26.01 


5,118 
27.92 


2,706 
27.40 


1,385 
28.35 


10, 749 
27.54 




TOTAL 


N 

Mean 


2,392 
31.35 


864 
28.46 


619 
29.36 


6,452 
29.46 


3,172 
28.75 


1,955 
30.62 


, 15/454 
29.70 


5 


Bottom 
One-Third 


N 
Mertft 


1,717 
26. 12 


402 
22.67 


369 
29.44 


1,658 
26.34 


663 
32.16 


725 
31.70 


5 534 
27.61 




Top 

Two-Thirds 


N 

Mean 


510 
22.08 


400 
25.13 


218 
25.25 


5,15* 
26.74 


2 ,940 
28.79 


1 480 
25.94 


10 700 
26.88 




TOTAL 


N 

Mean 


2,227 
25.19 


802 
23.89 


587 
27.88 


6,810 
26.64 


3,603 
29.41 


2,205 
27.84 


16,234 
27.13 


6 


Bottom 
One-Third 


N 

Mean 


1,450 
28.04 


480 
27.88 


412 
22.87 


1,553 
^8.09 


1,107 
26.36 


812 
27.18 


5,814 
27.23 




Top 

Two Thirds 


Mean 


532 
20.48 


425 
25.68 


208 
17.34 


5,338 
25.28 


4,698 
23.39 


1,703 
24.23 


12,904 
24.14 




O 

-Rir 


N 
Mean 


1,982 
26.01 % 


905 
26.85 


620 
21.01 


6,891 
25.91 


5,805 
2**. 95 


2,515 
25.18 


18,718 
25.10 





- 


- 






Table B2-2 


- 


- 


















Two-Kay ANOVA of Fall-to-Spring Hath VSS Gain by CE Status and initial Achievement Status 










R 


Initial 








CE 


Status (b) 














A 

* D 
E 


Achievement 
Status 
(A) 


Title I 
Students in 
Title I Schools 


Other-CE 
Students in 
Title I Schools 


CE Students 
in Other-CE 
Schools 


Non-CE Students Non-CE Students 
in Title I in Other-CE 
Schools Schools 


Students in 
Kon-CE 
Schools 


TOTAL 


















Math Gain Score Means 








* 






1 


Bottom 
One-Third 


K 

>tear. 


669 
64.65 


211 
63.14 


104 
62.78 


1*669 
64.81 


494 
65.84 


512 
60.08 


3*659 
64.11 










Top 

Two-Third s 


N 
>«c:.n 


929 
59.35 


644 
55.25 


225 
62.32 


6*771 
62.77 


2,990 
59.48 


1*620 
57.91 


13,179 
60.81 










TOTAL 


?: 

Mean 


1*598 
61.57 


855 
57.20 


329 
62.46 


8*440 
63.17 


3,484 
60.38 


2,132 
58.43 


16*838 
61.52 






- 


2 


Bottom 
Che- Third 


!l 
Moan 


934 

55^.28 


266 
58.48 


114 
53.84 


1 »881 
60.05 


530 
61.23 


536 
53.97 


4,261 
58.12 










Top 

Two- Thirds 


N 
Mean 


7*2 
, 51.18 


542 
51.76 


177 
54.69 


5* 618 
54.37 


2*717 
56.23 


1,411 
52.28 


11*217 
54.22 










TOTAL 


H 
Mean 


1*686 
53.45 


808 
53.97 


291 
54.36 


7* 499 
55.79 


3,247 
57.05 


1*947 
52.75 


15*478 
55.30 








3 


Botton 
One-Third 


N 

Mean 


1*119 
59.27 


300 
55.39 


153 
42.86 


1 * 934 
60.25 


600 
63.01 . 


578 
58.05 


4,684 - 
59.22 










Top 

Two-Thiids 


n 

Mean 


674 
48.86 


468 
46.22 


216 
48.76 


5* 367 
56.15 


2,589 
60.62 


1*364 
57.41 


10*678 
S6.35 










TOTAL 


N 
.Mean 


1 , 793 
55.36 


768 
49.80 


369 
46.32 


7*301 
57.24 


3,189 
61.07 


1*942 
57.60 


15*362 
57.23 








4 


Bottom 
One -Third 


N 

Moan 


885 
56. 31 


329 
45.50 


166 
40.25 


1*801 
55. 84 


681 
54.17 


530 
54. 31 * 


4*392 
54.13 










Top 

Two-Thirds 


K 
Mean 


549 
48.65 


516 

45. n 


207 
28.78 


5*594 
48.66 


2,734 
50.60 


1* 424 
- 48.72 


11,024 
48.61 




• 






TOTAL 


N 

Mean 


1,434 
53.38 


845 
;5.26 


373 
33.88 


7,395 
50.41 


3,415 
51.31 


1,954 
50.23 


15,416 
50.18 








5 


Bottom 
One-Third 


N 

.Mean 


883 
47.12 


301 
40.62 


229 
46.69 


2 008 
42.70 


779 
45.87 


643 
51.05 


4,843 
45.18 










Top 

Two-Thirds 


N 

Mean 


448 
37.38 


467 
35.78 


171 
36.14 


5,721 
42.95 


3*008 
47.82 


1 *560 
44.43 


11*375 
43.83 










TOTAL 


N 

Mean 


1*331 
43.64 


768 
37.68 


400 
42.18 


7,729 
42.89 


3,787 
47.42 


2,203 
46.36 


16*218 
44.23 








6 


Bottom 
One-Third 


N 

Mean 


650 
48.72 


368 
43.84 


262 
39.63 


1*960 
44.56 


1,229 
42.94 


658 
40.51 


5,127 
43.88 










Top 

Two-Thirds 


N 

Mean 


484 
37.71 


490 
35.63 


195 
31.54 


5,814 
38.94 


4*731 
38.23 


1,837 
38.69 


13,551 
38.39 










TOTAL 


N 

Mean 


1,134 
44.02 


858 
39.18 


457 
36.18 


7,774 
40.36 


5*960 
39.20 


2 495 
39.17 


•18*678 
39.90 








= E 
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Table B2-3 

One-way ANOVA of Fall-to-spring Standardized Reading/Hath 
VSS Gain by CE Status 







1 


2 


3 


4 


5 




6 






Reading 












Title I Students 


N 


2,785 


3,03& 


3,022 


2,392 


2,227 


1 


r 982 


in Title I Qr»hrw-»1 c 


Mean 


. 05 


• \j j 






• Ul 




.04 


Other-CE Students 


N 


987 


948 


884 


864 


802 




905 


in Title T Schools 


Mean 


-.05 


-.02 


— 

• Uj 


• Ul 


— .03 




• 04 


CE Students in 


N 


574 


704 


629 


619 


587 




620 


Other— CE School*? 


Mean 


-.16 


.09 


. 03 


• 00 






-.UJ 


Non-CE Students 


N 


7,140 


6,027 


5,977 


6,452 


6,810 


6, 


,891 


in Title I Schools 


Mean 


.03 


-r.Ol 


-.03 


-.01 


-.02 




.00 


Non-CE Students 


N 


3,238 


2,842 


2,92 7 


3,172 


3,603 


5, 


,805 


in Other-CE Schools 


Mean 


-.09 


-.03 ' 


•.01 


-.03 


.01 




-.03 


Students in 


N 


2,151 


1,954 


1,938 


1,955 


2,205 


2, 


515 


Non-CE Schools 


Mean 


.04 


-.02 


-.01 


.01 


.00 




.00 


TOTAL 


N 


16,875 


15,511 


15,377 


15,454 


16,234 


18, 


718 


Mean 


-.00 


-.00 


-.00 


-.00 


-.01 




-.00. 


F STATISTIC 




18.20* 


5.66* 


11.34* 


5.19* 


4.74* 


9.87* 






Math 












Title i btuaents 


N 


1,598 


1,686 


1,793 


1,434 


1,331 


1, 


134 


in Title I Schools 


Mean 


.13 


.04 


• 06 


• 10 


.07 




.13 


Other— CE Students 


N 


855 


808 


768 


845 


768 




858 


in Title I Schools 


Mean 


-.06 


-.01 




— • UD 


—.07 




.03 


CE Students in 


N 


*' 329. 


291 


369 


■a *7 


400 




457 


Other-CE Schools 


Mean 


.06 


.01 


T. 1*1 


— . 


.03 




.03 


Non-CE Students 


N 


8,440 


7,449 


7,301 


7,395 


7,729 


7, 


774 


in Title I Schools 


Mean 


.04 


.00 


-.01 


-.01 


-.04 




.00 


Non-CE Students 


N 


3,484 


3,247 


3,189 


3,415 


3,787 


5, 


560 


in Other-CE Schools 


Mean 


-.08 


-.01 


.02 


-.01 


.01 




.03 


Students in 


N 


2,132 


1,947 


1,942 


1,954 


2,203 


2, 


495 


Non-CE Schools 


Mean 


-.06 


-.04 


.00 


-.01 


.02 




.02 


TOTAL 


N 


16,838 


15,478 


15,362 


15,416 


16,218 


18, 


678 


Mean 


.00 


-.00 


-.00 


-.01 


-.01 




.00 


F STATISTIC 




21.76* 


2.55 


8.73* 


17.06* 


9.75* 


13 


.99* 



♦Means in standardized VSS gain scores differ significantly among the six analysis groups 
at .01 level. 
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Table B2-4 



One-Way ANOVA of Fall-to-Spring Reading/Math Gain in Terms of Standardized 
Normal Deviate (2) Scores for the Three Groups of CE Students 
and Two Comparison Groups of Needy Non-CE Stvdents 



Grade 



CE Status 




















1 


2 


' 3 


4 


5 


6 






Reading \ 










Title I Students 
in lixie jtnuuib 


N 

Mean 


2,785 
.01 


3,036 
.03 


3,022 
.07 


2,392 
.03 


2,227 
-.00 


1,982 
.03 


Other-CE Students 
in Title I Schools 


N 

Moan 


-.05 


948 
-.05 


884 

.00 


864 
-.02 


802 
-.03 


* 905 
.02 


CE Students in 
Other-CE Schools 


N 

Mean 


574 
-.16 


704 
.08 


629 
.04 


619 
.00 


587 ^ 
.03" 


620 
-.05 


Needy Non-CE Students 
in CE Schools 


N 

Mean 


1,999 
-.07 


1,572 
-.03 


1,473 
.04 


1,729 
.01 


1,899 
-.01 


2,124 
-.01 


Needy Non-CE Students 
in Non-CE Schools 


N 

Mean 


541 
-.11 


678 
-.05 


591 
-.03 


613 
.01 


548 
-.02 


676 
.01 


Total 


N 

Mean 


6,886 
-.04 


6,938 
.00 


6^599 
. .0.4 


6,217 
.01 


6,063 
-.01 


6,307 
.01 


F Statistic 




8.02* 


6.89* 


4.87* 


1.00 


1.27 


3.86* 








Math 










Title I Students 
in Title I Schools 

Other-CE Students 
in Title I Schools 

CE Students in 

Ohhor-CF Schools 


N- 
Mean 

N 

Mean 
N 

Mean 


1,598 
.12 

855 
-.06 

329 
.07 


1,686 
.04 

808 
-.02 

291 

l02 


1,793 
.13 

- 768 
-.01 

369 
, -.17 


1,434 
.08 

845 
-.08 

373 
-.21 


1,331 
.09 

768 
-.04 

400 
.04 


1,134 
.09 

858 
-.01 

457 
-.02 


Needy Non-CE Students 
in CE Schools 


N 

Mean 


1,599 
-.01 


1,353 
-.00 


1,370 
-.02 


1,455 
-.00 


1,606 
.02 


1,767 
-.03 


Needy Non-CE Students 
in Non-CE Srnools 


N 

Mean 


1,051 
-.15 


1,035 
-.06 


1,057 
-.04 


1,169 
-.00 


1,270 
-.01 


1,321 
-.04 


Total 


N 
Mean 


5,432 
-.00 


5,173 
-.00 


5,357 
.02 


5,276 
-.01 


5,375 
.03 


5,537 
-.00 


F Statistic 




. 17.65* 


2.85 


19.12* 


17.68* 


7.21* 


8.84* 



* Means in z-score gain differ significantly among the five analysis groups at .01 level* 
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Table B2-5 



„ Cne-Way ANOVA of Fall-to-Spring Standardized Reading/Math VSS Gain for the Three 
Groups of CE Students and Two Comparison Groups of Needy Non-CE Students 



Grade 



CE Status 




1 


2 


3 


4 


5 


6 






Reading 










Title I Students 
in Title I Schools 


N 

Mean ■ 


2,785 
.05 


3,036 
.03 


3,022 
• ud 


2,392 


2,227 
.01 


1,982 
. 04 


Other-CE Students 
in Title I Schools 


N 
Mean 


GOT 

-.05 


-.02 


884 
— . UO 


864 , 


802 
—.•03 


905 
* .04 


CE Students in 
Other-CE Schools 


N 

- Mean 


574 
-.16 


704 
.09 


629 
.03 


619 
.00 


587 
.04 


620 
-.03 


Needy Non-CE' Students 
in CE Schools 


N 

Mean 


1,999 
-.04 


1,572 
t.02 


1,473 
.03 


1,729 
.02 


1,899 
-.01 


2.124 
.00 


Needy Non-CE Students 
"in Non-CE Schools 


N 

Mean 


541 
-.07 


678 
- 4 04 


591 
-.05 


613 
.02 


548 
-.03 


676 
.03 


Total 


N 

Mean 


6,886 
-.02 


6,938 
.01 


6,599 
.02 


6,217 
.02 


6,063 
-.00 


6,307 
.02 


F Statistic v 




9.78* 


5.49* 


6.92* 


1.52 


2.23 


3.52* 








Math 










Title i Students 

in Title I Schools • 


N 

Mean 


1,598 
• j. j 


1,686 | 


1,793 
.06 


1,434 
.10 


1,331 
.07 


1,134 
.13 


Other-CE Students 
in Title I Schools 


N 
Mean 


855 
-.06 


808 
-.01 


768 
-.10 


845 
-.05 


768 


858 

• UJ 


CE Students in 
Other-CE Schools 


N 

Mean 


329 
.06 


291 
.01 


369 
-.14 


-.22 


Ann 
.03 


fl D I 

.03 


Needy Non-CE Students 
in CE Schools 


N 

Mean 


1,599 
-.00 


1,353 
-.01 


1,370 
-.05 


1,455 
.02 


1,606 
-.01 


1,767 
.01 


Needy Non-CE Students 
in Non-CE Schools 


N 

Mean 


1,051 
-.13 


1/035 
-.08 


1,057 
-.02 


1,169 
.00 


1,270 
-.04 


1,321 
-.00 


Total 


N 

Mean 


5,432 
.01 


5,173 
-.01 


5,357 
-.02 


5,276 
.01 


5,375 
-.00 


5,537 
.04 


F Statistic 




16.15* 


3.85* 


9.71* 


19.28* 


7.68* 


8.09* 



*Means in standardized VSS gain scores differ significantly among the five analysis 
groups at .01 level. 
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Table B2-6 

Average Fall-to-spring fSS Cain in Reading by CE status and Teacher's Judgment 
of Need in CE (Sample sixss Ara Givan in Parentheses) t 





Taachar's 

Judgment 
of CE Need 
(NEED) 




CE Status (CE) 


• 






Crada 


Tit la z 
Students in 
Titla I Schools 


Othsr-CE 
Stud ants in 
Titla I schools 


CE Studants Non-CE 
in Othsr-CE Studants in 
Schools CE schools 


Non-CE 
Students in 
Non-CE Schools 


t 


Total 


1 


Naad 
Don't Need 
Total 


58.03 (2,188) 
63.93 (579) 
59.26 s (2,767) 


51.42 
67.02 
59.42 


(479) 
(504) 
(983) 


49.27 
62.49 
54.18 


(361) 54.83 ~ 
(213) 69.97 
(574) 67.05 


(1,999) 
(8,339) 
(10,338) 


52.79 * (541) 
70.44 (1,629) 
66.04 (2,170) 


55.24 
69.46 
64.75 


(5,569) 
(11,264) 
(16,832) 




- Test Statistical 


Effect* 
P 


NEED 
636.82** 


CE|li 

7. a 


EED 
2** 


CE S NEEDlCE, NEED 
8.08** 




CE | NEED, CE x NEED 
5.87** 


2 


Naad 
Don't Naad 
Total 


42.78 (2,462) 
42.41 (525) 
42.71 (2,987) 


40.43 
42.31 
41.24 


(540) 
(402) 
(942) 


45.57 
47.79 
46.10 


(533) 39.79 
(169) 44.06 
(702) 43.30 


(1*572) 
(7,257) 
(8,829) 


38.41 (678) 
44.53 (1,259) 
42.39 (1,937) 


41.49 
44.02 
43.07 


(5,785) 
(9,612) 
(15,397) 




Tast statistical 


Effect* 
P 


NEED 
21.38** 


CE|N 
4.3 


EED 
2** 


CE x need|ce, NEED 
2.56 




CE|NEED, CE X NEED 
2.89 


3 


Kaad 
Don't Need 
Total 


36.01 (2,525) 

t *■» 11 /ao"t\ 

32.37 \482) 
35.4) (3,007) 


33.76 
30.26 
32.05 


(439) 
(420) 
(859) 


34.80 
34.24 
34.64 


(448) 34.10 
(176) 33.01 
(624) 33.19 


(1,473) 
(7,374) 
(8,847) 


29.48 (591) 
35.38 (1,357) 
33.59 (1,948) 


34.51 
33.21 
33.68 


(5,476) 
(9,809) 
(15,285) 




Tast statistics 


Effact* 

.P 


NEED 
5.98 


CE|N 
2.2 


EED 
1 


ce x need|ce, NEED 

5.84** 




CeInEED, CE x NEED 
1.25 


4 


5 Haad* 

Don't Naad 
Total 


31.36 (2,017) 
30.70 (329) 
31.27 (2,346) 


26.06 
32.40 
29.14 


(432) 
(407) 
(839) 


30.54 
25.50 
29.24 


(459) 30.10 
(159) 28.98 
(618) 29.18 


(1*729) 
(7,839) 
(9,568) 


30.25 (613) 
4».99 (1,335) 
30.07 (1,948) 


30.31 
29.25 
29.62 


(5,250) 
(10,069) 
(15,319) 




Tast statistics 


Effact* 
P 


NEED 

3.SO 


ce|m 

1.2 


EED 
B 


CE x need|ce, NEED 
• 2.93 




CE|NEED, CE x NEED 
.91 


5 


Naad 
Don't Naad' 
Total 


25.52 (1,834) 

24.33 (339) 

25.34 (2,173) 


25. 72 
22.72 
23.87 


iao3j 
(301) 
(786) 


27.44 
29.31 
27.83 


(462) 24.74 
(124) 28.24 
(586) 27.59 


(1,899) 
(8,453) 
(10,352) 


x 22.60 (548) 
29.57 (1,675) 
27.85 . (2,223) 


24.84 

28.26 
27.15 


(5,228) 
(10., 892) 
(16,120) 




Tast statistics 


Effact* 
P 


NEED 
41. 17** 


ce|ni 

1.8 


EED > 
9 


ce x need|ce, NEED 

2.88 




CE|NE£D, CE X NEED 
1.77 


6 


Masd 
Don't Naad 
Total 


26.83 (1,671) 
24.38 (272) 
26.48 (1,943) 


27.73 
25.34 
26.74 


(526) 
(373) 
(899) 


21.52 
19.64 
21.07 


(471) 23.89 
(148) 25.24 
(619) 25.01 


(2,124) 
(10,502) 
(12,626) 


25.14 (676) 
25.28 (1,871) 
25.24 (2,547) 


25.11 . 

25.17 

25.15 


(5,469) 
(13,166) 
(18,634) 




Tsat statistics 


Effact* 
P 


NEED 

.01 


ce|ni 

4.0! 


^Ef> 
>** 


ce x need|ce, NEED 

1.41 




Ct|>£ED, CE x NEED 
2.90 


T 
1 





1976. 



Studants with missing data for CE status, taachar's judgaant of naad for < 



tteeoher'a j nrtg ej sn t of naad in reading CE was suds in October - No venber, 
e* tast scores ware excluded in the analysis. 
•■BD • unadjusted differences between studants who were judged to be in need of CE and thoee who were not so judged! Ce|neeD « diffs ranees anong students 
°L d f f l! r r t °? f Utu *** f fttr «*jmting for differences with reepect to judged need in CEi CE x NEEd|ce, NEED - interaction effecte betwen CS statue 
and judfed need in CE; CE|MEED, CE x NEED - CE effecte adjusted for both nain effects of NEED and \hs interaction effects between CE and NEED, 
■•f ignificaut at the .01 level. 
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Table B2-7 

Averags Fall-to-Spring VSS Cain in Hath by CE ftatus and Teacher'e Judgment 
of Naed in CE (Sample Sixes Are Given in Parentheses) t 



Grade 



Teacher's 
Judgement 
of CE Need 
(NEED) 



Need 
Don't Need 
Total 



Title I 
Students in 
Title I schools 



Other-CE 
Studenta in 
Title I School! 



59.70 (1.163) 
€6.93 (421) 
61.62 (1,584) 



57.65 
56.61 
57.02 



*336) 
(516) 
(852) 



CE Statue (CE) 



CE Studenta 
in Other -CE 
Schools 



Non-CE 
Students in 
CE Schools 



56.89 
69.28 
62.46 



(181) 
(148) 
(329) 



54.13 
64.62 
62.74 



(1,599) 
(7,335) 
(8,934) 



Non-CE 
Studente in 
Non-CE Schools 



Total 



49.13 (1,051) 
62.93 (4,044) 
60.09 (5,095) 



54.80 (4,330) 
63.87 (12,464) 
61.53 (16,794) 



Test Statietices 



Effect* 

F 



NEED 
222.62" 



ce|need 

14. 58" 



ce x needIce, need 

8.37" 



Ce|nEED, CE X NEED 
12. 77" 



Need 
Don't Need 
Total 



51.11 (1,187) 
59.19 (454) 
53.35 (1,641) 



51.28 
56.20 
53.96 



(366) 
(438) 
(804) 



47.20 
62.50 
54.27 



(156) 
(134) 
(290) 



50.47 
58 62 
57.23 



(1,353) 
(0,594) 
(7,947) 



46.74 (1,035) 
54.94 (3,646) 
53.13 (4,681) 



49.66 (4,097) 
57.40 (11,266) 
55.34 (15,363) 



Test Statistics* 



Effect* 
f 



NEED 
130.00" 



ceIneed 

8.27" 



CE X NEB0|CE, NEED 
1.04 



CE|nERO, CE X NEED 
5.73" 



Don't Need 
Total 



55.04 
56.89 
55.46 



(1,380) 
(399) 
(1.779) 



43.94 

56.27 
50.77 



(332) 
(412) 
(744) 



40.14 
54.21 
46.54 



(199) 
(166) 
(365) 



49.07 
58.85 
57.13 



(1,370) 
(6,403) 
(7,773) 



50.11 (1,057) 
63.49 (3,551) 
60.42 (4,608) 



50.42 (4,338) 
60.12 (10,931) 
57.36 (15,269) 



Tsst Statistics x 



Effect* 
F 



NEED 
177. 32" 



ce|need 

15. 40" 



CE x need Ice, need 

4.88" 



CE | NEED, CE X NEED 
8.30" 



Need 
Don't Need 
Total 



53.47 (1,1262 
53.80 (283) 
53.54 (1,409) 



45.37 
47.15 
46.30 



(386) 
(423) 
(809) 



45.04 
10.79 
33.90 



(251) 
(121) 
(372) 



48.22 
50.87 
50.38 



(1,455) 
(6,478) 
(7,933) 



46.97 (1,169) 
51.96 (3,599) 
50.74 (4,768) 



48.80 (4,387) 
50.71 (10,904) 
50.17 (15,291) 



Test Statistics: 



Effect* 
F 



NEED 
6.67* 



ce|need 

18. 59" 



CE X need |ce, need 

16. 97" 



Ce|N£ED, CE x NEED 
25. 21" 



Need 
Don't Need 
Total 



44.82 (1,002) 
40.28 (283) 
43.82 (1,285) 



35.72 
41 44 

38.27 



(414) 

: (333) 
» (747) 



42.06 
41.72 
41.96 



(281) 
(118) 
(399* 



38.86 
47.05 
45.46 



(1,606) 
(6,680) 
(8,286) 



35.75 (1,270) 
45.89 (4,114) 
43.50 (5,384) 



39.22 
46.25 
44.25 



Test Statistical 



Effect* 
F 



NEED 
82. 22" 



ce|need 

4.34" 



ce x need|ce, need 

5.71" 



CE | NEED , CE X NEED 
2.38 



Don't Need 
Total 



44.12 (883) 
44.88 (226) 
44.27 (1,109) 



36.77 
42.37 
39.76 



(391) 
(448) 
(839) 



36.11 
37.52 
36.55 



(315) 
(141) 
(456) 



35.43 
39.52 
38.83 



(1,767) 
(8,613) 
(10,380) 



33.73 
43.70 
41.44 



(1,321) 
(4,489) 
(5,810) 



36.75 (4,677) 
41.03 (13,917) 
39.95 (18,594) 



Test Statietices 



Effect* 
F 



NEED 
30.53** 



ceIneed 

10. 99" 



CE X NEE0|CE, NEED 
3.39" 



CE|nEED, CE X NEED 
4.08" 



treacher's judgment of need in stath CE was aade in October-Novesiber, 1976. Studente with nicsing data for CE status, teacher's judgment of need for CE, 

or test scores were excluded in the analysis. # - 

•Itexn m im^iiusted differences between etudents who were judged to be in need of CE and those who were not so judgad; CEINEED • differencas eeong student! 
ol O ► CE statue* ■ after adjusting for differences with respect to judged need in CE) CE x NEEd|ce» NEED » interaction effftc+e between CE status 
"FR CZt ceIneed, CE x NEED - CE effects adjusted for both Min effects of NEED and the interect}fn ef facte between CE and NEED. 



ignlficant at the .01 level. 



Table B2-8 

One-Way ANOVA of Fall-to-Spring Standardized Gain Scores in Practical 
Achievement for the Three Groups of Reading/Math CE Students 
and Two Comparison Groups of Needy Non-CE Students* 



CE Status 



Reading CE Status 



Math CE Status 







Grade 4 


Grade 5 


Grade 6 


Grade 4 


Grade 5 




Title I Students 
in Title I Schools 


Mean 


2,367 
-.02 


2,218 
-.01 


.05 


X, ft^O 

-.03 


i, J21 
-.01 


1,138 
.03 


Other-CE Students 
in Title I Schools 


N v 
Mean 


868 
.03 


798 
• 04 


894 
.06 


.00 


*7 C*7 
IDI 

.01" 


839 
.05 


CE Students in 
Other-CE Schools 


N 
Mean 


609 
-.07 


576 
-.04 


613 
. 08 


366 

-.11 


392 
-.02 


450 
.12 


Needy Non-CE Students 
in CE Schools 


N 

Mean 


1,730 
.02 


1,874 
.02 


2,115 
.07 


li,469 
-.01 


1,597 
.02 


1,760 
.09 


Needy Non-CE Students 
in Non-CE Schools 


N 
Mean 


577 
.02 


521 
-.02 


, 637 
.08 


1,138 
-.03 


1,237 
-.05 


l,29tt 
•°* 


Total - 


N 
Mean 


:f ' 6,151 
-.00 


5,987 
.00 


6,238 
.06 


5,243 
*-.02 


5,304 
-.01 


5,477 • 
.06 


P Statistic 




2.72 


1.48 


.38 


1.86 


1.54 


2.73 



* Mean standardized gain scores in practical achievement do not differ- significantly among the 
five analysis groups at .01 level. ' ' 9 e 
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Table B2-9 

One-Way ANOVA of Fall-to-Spring standardized Change Scores in Student 
Affect for the Three Groups of Reading/Math CE Students 



f and Two Comparison Groups of Needy Non- 
' » 


-CE Students 





• 










Gradq 






CE Status 


- 


2 


3 


4 


* 5 


6 


Readinq CE Status 




- 










Title I Students 
in Title I Schools 


N 
Mean 


2,748 
.02 


2,784 
-•00 


2,206 
-.00 


2,097 
m .02 


1,867 
.08 


Other-CE Students 
in Title I Schools 


N 
Mean 


869 
• 15 


826 
-.02 


828 
-.04- 


753 
-.03 


847 
.03 


CE Students in 
otner— ut» aonoois 


N 
Mean 


651 
-•02 


593 
.00 


586 " 
-.00 


555 
• 11 


584 
.06 


Needy Non-CE Students 
in CE Schools 


N 

Mean 


1,423 
-.03 


1,369 
.03 


1,644 

• 0^ 


1,785 


2,022 
• 04 


Needy Non-CE Students 
in Non-CE Schools t 


N 
Mean 


578 
.07 


547 
-•06 


566 
• 07 


501 
-.04 


628 
• 00 


Total 


N 
Mean 


6,269 
• 03 


6,119 
-.00 


5,830 
• 01 


5,691 
.02 


5,948 
.05 


F Statistic ^ 




4.13* 


.77 


1.04 


2.38 


1*07 • 



Math CE Status 



Title I Students 
in Title I Schools 


N 

Mean « 


1,500 
.00 


1,651 
.01 


1,324 
-.02 


1, 


268 
.02 


1,057 
.16 


Other-CE Students 


N 


725 


679 


799 




704 


807 


in Title I Schools 


Mean 


.05 


.04 " 


-.04 




.06 


-.01 


CE Students in 


N . 


279 


353 


353 




375 


432 


Other-CE Schools 


Mean 


.13 


-.04 


.01 




.06 


.15 


Needy Non-CE Students 
in CE Schools 


N 
Mean 


1,233 
.03 


1,289 
-.01 


1,370 
."04 


1 


483 
.01 


1/B77 
.04 


Needy Non-CE Students 
in Non-CE Schools 


N 
Mean 


897 
.06 


993 
.03 


1,095 
.03 


I 


,201 
-.00 


1,249 
.03 


Total 


N 


4,634 


4,96,5 


4,941 


5 


,029 


5,222 


Mean 


.-04 


s.Ol 


.01 




.02 


.06 


F Statistic 




1.07 


.57 


1.22 




.65 


" 6.03 



* Moan standardized change scores in student 
t five analysis groups at .01 level. 



affect differ significantly among the 
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Analysis for Reading and Math Achievement 

_In the past decade, attention has concentrated on improving the ANCOVA techni- 
j que through corrections for unreliabilities when fallible measures are employed 
as covariates, Porter (1967) proposed a method for such corrections, that is 
simple and easy to implement* * Essentially, he suggested the use of^estimated 
true scores bas.ed on wi thin-group regression as the covariate $ Mb¥£ e£aborate*d 
corrections originated from Lord's (1960) idea of large-sample coVariajice ana- 
lysis have^been devised by DeGracie and Fuller (1^972) . Rindskopf (1976) applied 
. both Porter's' correct ion and the method of DeGracie and Fuller to analyze the 
same data and found no substantial disagreement in the results. For practica- 
lity, we adopted Porter • s. method for the corrections in the present analyses. 
Even with the corrections for unreliabilities, large preexisting differences 
may still not be adequately adjusted unless a complete discriminate variate 
can be found to serve as the covariate (Cronbach et al,, 1976)* Attempts to 
obtain more comparable x ^rotips for this type of analysis can often help reduce 

• the regression ,effe6ts that present major problems in these analyses* With 
these considerations, we explored four different sets of analyses using dif- 
ferent ^groups: ^ - 

JThe Six CE Groups. The substantial preexisting differences among the groups 
are'likely to oe under-adjusted with the technique, • But we proceed, with the 
analysis so that the appropriat jness of the corrections for unreliabilities of 
the covariates can be examined. Because of the large sample that entails ex- 
t horbitant computer costs for the analysis.* we reduced the amount, of data by 
„ selecting a 30 percent random sample of the oon-CE^sfcudents to supply tht data 
for the three non-CE, groups , but kept the tljiree groups of CE students invact 
so that 'they would be well represented. 

* The Three Groups of CE Students Plus the Two Comparison Groups of Needy Non-CE 
Students in CE and in^ Non-CE Schools. These groups prove to be more comparable 
with one andther than* in the preceding case. 

The Three Groups of CE Students Plus a Comparison Group that Consists of Needy 
Non-CE Students in Non-CE Schools with High Concentrations of Low-Achieving and 
Poverty Students. This comparison group is selected because its students come 
from non-CE schools with characteristics similar to those of CE schools. 

The Group of All CE Students and the Two Comparison Groups of Needy Non-CE 
Students. 

In each analysis, the pretest score serves as the covariate, and the posttest ♦ 
score is the -dependent variable. The most important task in the implementation 
of Porter's* method is to obtain a reasonable estimate of t*he pretest reliabi- 
lity. Unfortunately, accurate estimates are often not available. The best 
recommendation to date is to try. the same analysis on a range of reliability 
estimates. If the analyses converge to the same results r we would have rea- 
sonable confidence in the' findings . Accordingly, we^ decided to do the analyses 
using values from" .6 to 1.0 (no correction) in steps of *10 as the correction 
factors. This range is selected on the basis of the reliability estimates 
computedupreviously for the CTBS tests* (see" Chapter 1 of Report 9) ♦ 

For each se^of the ANCOVA, supplementary analyses that examine differences in 
pretest means and the validity of the assumption of homogeneous within-group 
regressions were performed. Their results are provided in this report so that 
the readers may make their own judgments on the validity of the ANCOVA results ♦ 
Even under the situation where within-group regressions are heterogeneous, one 
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may still be able to extract information from the adjusted group means obtained 
with the ANCOVA. 

Specifically, according to Rubin's (1976, 19'. !) definition (i.e. / the treatment 
effect is the difference between the expected means in the population under the 
treatment and the control conditions), the treatment effects can be evaluated 
by comparing the adjusted group means computed with a common regression coef- 
ficient that is a weighted composite of the heterogeneous regression coefficients. 
When the within-group regressions are homogeneous, the comparison would be 
equivalent to the test of equality of adjusted group means in the ANCOVA. On 
the other hand, when the wi thin-group regressions are unequal, the differences 
in regression coefficients may be examined to further our understanding of the 
group differences in general. The consequences of violating the equal -slope 
assumption vary depending on the pattern of differences among the slopes and 
the covariate means. In many cases, the adjusted group means may still be 
compared to obtain some approximations of ttie treatment effects* Under the 
condition of heterogeneous regressions, the estimated common regression coef- 
ficient with the ANCOVA model is actually also a weighted composite of the 
unequal within-group coefficients, though it may not correspond to that re- 
quired in the calculation of treatment effects under Rubin's model (essentially, 
in Rubin's case, sample Ns constitute the weights). 

v 

Additionally, one should also recognize that if the covariate means differ in- 
substantially, violations of the ANCOVA assumptions may often be inconsequen- 
tial* Under thi^s circumstance, the primafry function of the. ANCOVA model is 
to remove the error variances due to variations of the concomitant variable, 
and thus provide a more sensitive test for the treatment effects. 

* 

The results for the firs* three sets of ANCCyJAs invariably indicate violations 
of the equal-slope assumption. These results are summarized in Tables B3-1 
through B3-6. As explained in Lindley, (1957), when the .sample is large, 
significant differences may be obtained even if the data indeed give greater 
support to the null hypothesis than other specific alternative, hypotheses. 
Because of the extremely large samples involved in our analyses,, the F-r&tios 
are very sensitive to violations of the assumption. For this arifl other rea- 
sons given earlier, the reader may wish to study the data in this Appendix to 
gather some useful information, but should do so with caution. 
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Table Bi-1 

Mean Reading and Math Achievement Scores and Within-Group Regressions 
of Posttest on Pretest Scores by CE Status* 



Grade 




Title I 
Students in 
Title I Schools 


Other-CE - 
Students in 
Title I Schools 


CE Students 
in Other-CE 
Schools 


Non-CE Students 
in Title 1 
Schools 


Non-CE Students 
in Other-CE 
School s** 


Students in 
Non-CE 
Schools** 








Reading 








Grade 1 


N 


2,705 * 


* 937 


574 


2,115 


967 


585 


Pall (Pretest) 
Spring (Posttest) 
With^n-Group Slope 


Mean 
Mean 


323.73 
382.96 
.75 


337.21 
396 .81 
.94 


336.03 
390 .21 
.80 , 


348.86 
416.70 
.87 


358.05 
423.04 . 
.99 


341.15 
408.02 
.81 


Grade 2 


N 


3,036 


948 


704 


1,754 


820 


569 


Fall (Pretest) 
Spring'* (Posttest) 
Within-Group Slope 


Mean 
Mean 


380.63 
423.30 
.70 ' 


405.50 . 
446.8 1 
.84 


3S7.82 
433 .78 
.70 


42.7.23 
470.79 
.87 


440.40 
483.08 
.77 


413.91 
454.27 
.82 


Grade 3 


N 


3,022 


884 


629 


1,761 


836 


581 


Fall (Pretest) 
Spring (Posttest) 
Within-Group Slope 


Mean 
Mean 


415.43 
450.74 
.73 


442.48 
473 .04 
.81 


428.67 
463 . 22 
.77 


471.61 
503.73 
.87 


485.74 
517.94 
.84 


„ 460.34 
494.83 
.36 


Grade 4 


N 




864 


619 


1,876 


940 


564 


Jail (Pretest) 
Spring (Posttest) 
Within-Group Slope 


Mean 
Mean 


439 .p4 I 
47*/09 
7.70 


463.73 
492.20 
.90 


455.53 
484.89 
.78 


506.45 
535.84 
.88 


519.57 
Q 549.11 
.86 


496.46 
528.70 
.89 


Grade 5 


N 


^,227 


802 


587 


1,992 


1,041* 


651 


Fall (Pretest) 
Spring (Posttest) 
Withm-Group Slope 


Mean 
Mean 


465/46 
490.65 
.79 


496.68 
^ 520.57 
' .93 


476.11 
505.99 
.84 


535.32 
562/45 
.93 


546.69 
575.66 
.95 


525.53 
555 .59 
.91 


Grade 6 A 


N 


1,982 


905 


620 


1,992 


1,712 


751 * 


Fa 1*1 (Pretest) 
Spring (Posttest) 
Within-Group Slope 


Mean 
Mean 


489.77 
515.78 
.78 


520.53 
547.38 
.92 


496.84 
517.86 
.84 


569.35 
596.21 
.92 


574.47 
597.81 
.92 


553.87 
578.46 
.94 








Math 










Grade 1 


N 


1,598 


855 


329 


2,468 


1,014 


620 


Fall (Pretest) 
Spring (Posttest) 
Within-Group Slope 


Mean 
Mean 


309. 33 
370.90 
.73 


325.62 
382.82 ' 
.70 


324.98 
387 .44 
.89 


331.25 
394.27 
.86 


339.21 
400.62 
.84 


329.16 
388.23 
.78 


Grade 2 


N 


1,686 


808 


291 


2,207 


938 


558 


Fall (Pretest) 
Spring (Posttest) 
Within-Group Slope 


Mean 
Mean 


362.41 
415.87 
.70 


386.12 
440 . 09 
* .77 


- 380.94 
435 .30 
.88 


395.27 
451.78 
.83 


405.81 
463.56 
.81 


389.02 
445.28 
.82 


Grade 3 


N 


1,793 


768 


369 


2,126 


932 


590 


Fall (Pretest) 
Spring (posttest) 
Within-Group Slope 


Mean 
Mean 


407.76 
463.12 
.69 


-401.02 
480.82 
.73 


425.93 
472.24 
.99 


447.86 
S03.40 
.80 


460.32 
520*732 
.90 


446.47 
504.35 
.84 


Grade 4 


n 


1,434 


845 


3/3 


2,178 


9b4> 


* 580 


Fall (Ptetest) » 
Spring (Posttest) 
Within-Group Slope 


Mean 
Mea' 


444.94 
498.32 
.74 


473.26 
518.52 
* .88 


466.94 
500.82 
.79 


498.62 
549138 
.83 


514.05 
565.16 
.88 


491.68 
541.67 
.89 


Grade 5 


N 


1, 331 


768 


400 


2, 266 


1,113 


653 


Fall (Pretest) 
Spring (Posttest) 
Within-Group Slope 


Mean 
Mean 


486.74 
530.59 
.73 


• 520.44 
558.12 
.87 


496.61 
538.79 
.81 


544.48 
587.31 
.92 


554.65 
601.16 
.91 


537.65 
583.68 
.91 


Grade 6 


N 


1,134 


858 


457 


2,272 


1,711 


757 # 


Fall (Pretest) 
Spring (Posttest) 
Within-Group Slope 


Mean 
Mean 


526.54 
570.57 
.72 


551.31 
590.50 
.88 


525.29 
561.47 
.84 


584.59 
624.73 


592.71 
633.85 
.93 


581.81 
620. 2^ 
.95 



• Test of equality of i 
•* A random sample from 



lopes among the grouos shows significant differences at .01 level in all cases, 
all non-CE students was obtained to supply the doca for these groups. 
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, Table B3-2 

ANCOVA of Reading and Math Scores for the Six CE Groups 
with Unreliability Corrections for the Pretest Scores 



Title X Other-CE 
D Reliability! students in Students in 
£■ Estimate Title X Schools Title X Schools 



1.0 
.9 
.8 
.7 
.6 

1.0 
.9 
.8 
.7 
.6 

1.0 
.9 
.8 
.7 
.6 

1.0 
.9 
.8 
. 7 
.6 

1.0 
.9 
.8 
.7 
.6 

1.0 
.9 
.8 
. 7 
.6 



CE Status 



CE Students Non-CE Students Non-CE Students Students xn Common * 
in Other-CE Non-CE Regression 

Schools - 



in Other-CE 
Schools 



in Title X 
Schools* 



Schools* Coefficient 



395.30 
396.67 
398.38 
400.58 
403.52 

441.10 
443.08 
445.55 
448.73 
452.96 

473.33 
475.84 
478.98 
483.02 
488.40 

501.18 
504.52 
508.70 
514.07 
521.23 

526.79 
530.81 
535.83 
542.28 
550.89 

558.84 
563.63 
569.61 
577.30 
587.56 



397.74 
397.85 
397.'/8 
398.15 
398.37 

445.17 
444.99 
444.76 
444.47 
444.08 

473.82 
473.90 
474.01 
474.15 
474.33 

502.35 
503.48 
504.89 
506.70 
509.12 

528.82 
529.74 
530.89 
532.36 
£34.32 

562.97 
564.70 
566.87 
569.65 
573.36 



Adjusted Group Means - Reading 

392.14 407.79 

392.36 406.80 

392.63 405.56 

392.97 403.97 

393.43 401.85 



445.96 
447.31 
449.00 
451.18 
454.08 

475.14 
476.46 
478.12 
480.25 
483.09 

501.86 
503.75 
506.10 
509.13 
513.17 

530.83 
533.59 
537.04 
541.48 
547.39 

554.60 
558.68 
563.79 
570.35 
579.10 



452.17 
450.10 
447.51 
444.19 
439.75 

481.00 
478.47 
475.32 
471. '26 
465.85 

510.49 
507.67 
304.15 
499.62 
493.59 

536.18 
533.26 
529.61 
524.92 
518.66 

566.19 
565.08 
561.19 
556.19 
549.51 



40b . 36 
404.51 
402.19 
399.21 
395.24 

454.17 
450.95 
446-94 
441.77 
434.89 

48 3.81 
480.02 
475.26 
469.19 
461.06 

512.87 
506.84 
503.80 
497.33 
488.70 

539.23 
535.18 
530.12 
523.61 
514.94 

565.23 
561.60 
557.08 
551.26 
543.50 



Adjusted Group Means - Math 



405.63 
405.36 
405.03 
404.60 
404.03 

446.05 
445.14 
444.00 
442.53 
440.57 

481.20 
479.68 
477.79 
475.36 
472.11 

511.66 
509.77 
507.40 
504.36 
500.30 

538.06 
536.11 
533.67 
530.54 
526.37 

564.28 
562.70 
560.73 
558.20 
554.82 



.85 
.94 
1.06 
1.21 
1.41 

.78 
.87 
.98 
1.12 
1.30 

.81 
.90 
1.01 
1.15 
1.34 

.83 
.92 
1.04 
1.19 
1.38 

.89 
.99 
1.12 
1.28 
1.49 

.89 
.99 
1.12 
1.28 
1.49 



41.-98 
29.35 
18.56 
12.08 
14.42 

28.80 
11.32 

2.67*% 

9.28 
<41.52 

20.80 

4.84 

4.68 
30.18 
96.08 

* 23.38 
4.65 
3.95 
32.25 
105.55 

25.49 
4.69 
8.42 

51.37 
154.92 

20.66 
4.92 
22.17 
91.22 
239.05 



1.0 
.9 
.6 
.7 
.6 


384.36 
385.86 
387.73 
390.13 
393.34 


383.24 
383.28 
383.34 
383.42 
383.52 




388.38 
388.48 
388.61 
388.78 
389.00 


390.18 
389.73 
389.16 
386.43 
387.46 


390.17 
389.00 
387.55 
385.69 
383.20 


385.82 
385.55 
385.22 
384.79 
384.22 


.80 
.89 
1.00 
1.14 
1.33 


C 9.14 
5.86 
4.14 
5.61 
13.27 


1.0 
.9 
.8 
.7 
.6 


434.46 
436.53 
439.11 
442.43 
446.86 


439.94 
439.93 
439.91 
, 439.88 
439.85 




439.25 
439.69 
440.24 
440.94 
441.88 


444.40 
443.58 
442.55 
441.23 
439.48 


447.84 
446.10 
443.92 
441 .11 
437.37 


442.84 
442.57 
442.2,3 
441.80 
441.21 


.79 
.88 
.99 
1.13 
1.32 


18.92 
9.56 
2.56«*- 
.53" 
8.37 


1.0 
.9 
.8 
.7 
.6 


485.01 
487.45 
490.49 
494.40 
4*9.61 


484.27 
484.66 
485.14 
485.75 
486.58 




479.73 
480.56 
481.60 
482.94 
484.73 


493.50 
492.40 
491.02 
489.25 
486.90 


500.54 
498.35 
495.60 
492.07 
487.36 


495.55 
494.58 
493.36 
491.78 
489.69 


.79 
.88 
.99 
1.13 
1.3? 


28.66 
17.49 
9.74 
8.80 
20.64 


1.0 
.9 
.8 
.7 
.6 


529.96 
533.48 
537.88 
543.53 
551.00 


526.64 
527.54 
528.67 
530.12 
532.05 




514.19 
515.68 
517.53 
519.92 
523.11 


536.43 
534.99 
, 533.19 
530.88 
527.79 


539.38 
536.51 
532.93 
528.33 
522.19 


534.48 
533.68 
532.68 
531.40 
5*3.69 


.83 
.92 
1.04 
1.19 
1.38 


26.71 
17.98 
16.>3 . 
26.. 6 ON, 
58.40 


1.0 
.9 ' 
.8 
.7 
.6 


566.62 
570.63 
575.63 
582.07 
590.65 


564.73 
565.46 
566 . 38 
567.56 
569.13 




566.21 
569 . 26 
573.07 
577.96 
584.49 


572.92 
571.32 
569.33 
566.76 
563.33 


577.89 
575.30 
572.07 
567.92 
562.38 


575.25 
574.32 
573.15 
571.64 
569.64 


.87 
.97 
1.09 
1.25 
1.46 


12.51 
5.08 
5.38 
19.36 
57.08 


1.0 
.9 
.8 
.7 
.6 


608.53 
612.75 
618.02 
624.80 
633.84 


606.48 
608.26 
610.48 
613.33 
617.14 




600.54 
604.88 
610.31 
617.29 
626.59 


611.19 ■ 

609.69 

607.81 

605.39 

602.17 


613.11 
610.80 
607.92 
604.22 
599.28 


609.15 
607.92 
606 . 38 
604.41 
601.77 


.89 
.99 
1.11 
1.27 
1.48 


6.55 

2.65" 

8.40 
30.93 
82.31 



• A randoa sample from all non-CE students was obtained to supply the data for these groups. 
Adjusted Group Means do not differ significantly among the groups at .01 level. 
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Table B3-3 



Meaiv Reading and Hath Achievement Scores and Within -Group Regressions of Posttest on Pretest Scores 
for the ^ftree Categories of CE Students and the Two Coaparison Groups of Needy Non-CE students* 



Title Z Other-CE CE students Needy Non-CE Needy Non-CE 

Students in students in in Other-CE students in students in 
Title I Schools Title I Schools Schools CE Schools Non-CE Schools 



Grade 



Reading 



Grade 1 


N 


2,785 


987 


574 


1,999 


541 


Pall (Pretest) 


Mean 


323.73 


- 337.21 


336.03 


323. 35 


321 .99 


Spring (Posttest) 


Mean 


382.96 


396.81 


390.21 


378.18 


374.78 


Within-Group Slope 




.75 


.94 


.80 


.62 


.62 


Grade 2 


N 


3,036 


948 


704 


1,572 


678 


Pall (Pretest) 


Mean 


380.63 


405.50 


' s> 387.82 


382.50 


377. 55 


Spring (Posttest) 


Mean 


423.30 


446.81 


433.78 


422.28 


415.96 


Within-Group Slope u 




.70 


.84 


.70 


.72 


.58 


Grade 3 - 


N 


3,022 


884 


629 


1,473 


591 


Pall (Pretest) 


Mean. 


415.43 


442.48 


428.67 


422-83 


416.96 


Spring (Posttest) 


Mean 


450.74 


473.04 


463.22 


456.94 


*446.45 


Within-Group Slope 




.73 


.81 


.77 


.75 


-62 


Grade 4 




2 392 


OK>H 


619 


1 , 729 


613 


Pall (Pretest) 


Mean 


439.74 


463.73 


455.53 


451.55 • 


445.25 


Spring (Posttest) 


Mean 


471.09 


492.20 


484.89 


481.65 


475.51 


Within-Group Slope „ 




.70 


.90 


.78 


.73 


.81 


Grade 5 


N 


2,227 


802 


587 


1,899 


548 


Pall (Pretest) 


Mean 


465.46 


496.68 


478.11 


478.23 


463.57 


Spring (Posttest: 


Mean 


490. 05 


520.57 


505.99 


502.97 


486.17 


Within-Group Slope 




.79 


.93 


.84 


.82 


.83 


Grade 6 


N 


1,982 


905 


620 


2,124 


676 


Fall (Pretest) 


, Mean 


489.77 


520.53 


496.84 


509.73 


493.57 


Spring (Posttest) 


■S 

r Mean 


515.78 


547.38 


517.86 


533.61 


518.71 


Within-Group Slope 




.78 


.92 


.84 


.81 


.82 









o 


Math 






Grade 1 


N° 


1,598 


855 


329 


1,599 


1,051 


Fall (Pretest) 


Mean 


309.33 


325.62 


324.98 


304.20 


307.25 


Spring (Posttest) 


Mean 


370.90 


382.82 


387.44 


358.33 


356.38 


Wit hi i. -Group Slope 




.73 


.70 


.89 


.61 


.56 


Grade 2 


N 


1,686 


808 


291 


1,353 


1,035 


Fall (Pretest) 


Mean 


362.41 


386.12 


380.94 


361.38 


360.14 


Spring (Posttest) 


Mean 


415.87 


440.09 


435.30 


411.85 


406.89 


Within-Group Slope 




.70 


.77 


.88 


.70 


.67 


Grade 3 


i; < 


> 1,793 


768 


369 


1,370 


1,057 


"Fall" (Pretest) 


Mean 


407 . 76 


431.02 


425.93 


407.20 


404.99 


Spring (Posttest) 


Mean 


463.12 


480.82 


472.24 


456.27 


455.10 


Within-Group Slope 




.69 


.73 


.99 


..71 


.59 


Grade 4 


N 


1,434 


845 


373 


1,455 


1,169 


Fall (Pretest) 


Mean 


444.94 


473.26 


466.94 


450.27 


448.04 


Spring (Posttest) 


Mean 


498. 32 


518.52 


. 500.82 


498.49 


495.01 


Within-Group Slope 




.74 


.88 


.79 


.74 


.76 


Grade 5 


N 


1,331 


768 


400 


1,606 


1,270 


Fall (Pretest) 


Mean 


486.74 


520.44 


496.61 


490.84 


487.28 


Spring (Posttest) 


Mean 


530.59 


558.12 


538.79 


529.69 


523.03 


Within-Group Slope 




.73 


.87 


.81 


.74 


.78 


Grade 6 


N 


1,134 


858 


457 


1,767 


1,321 


Fall (Pretest) 


Mean 


526.54 


551.31 


525.29 


530.80 


524.41 


Spring (Posttest) 


Mean 


570.57 


590.50 


561.47 


, 566.23 


558.14 


Within-Group Slope 




.72 


.88 


.84 


.75 


.77 



Within-Group Slopes differ significantly among categories at the .01 level in all cases. 

i 
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Table B3-4 



AWCDVA of Reading and Math Achievement Scores for the Three Croups of CE Students and Two Comparison 
Groups of Needy Non-CE Students with Unreliability Corrections for the Pretest Scores 



Reliability 
Estimate 



CE Status 



Title I 
Students in 
Title Z Schools 



Other-CE CE Students Needy Non-CE Needy Non-CE Common 
Students In in Other-CE Students in Students in Regression 
Title I Schools Schools CE Schools Non-CE Schools Coefficient* 



Adjusted Group Means - Reading 



1.0 


384.96 


368.85 


38?. 13 


380.46 


378.07 


74 


14.23 


.9 


385.18 


387.97 


382.34 


380.71 


378.43 


.82 


11.99 


.8 


385.46 


366.87 


381.36 


381.03 


378.89 


.92 


10.04 


.7 


385.82 


385.45 


380.09 


381.44 


379.48 


1.05 . 


8.90 


.6 


386.29 


383.56 


378.41 


381.98 


380.26 


1.2? 


9.66 


1.0 


426.34 


432.05 


431.67 


423.99 


421.21 


.72 


16.41 


.9 


426.68 


430.40 


431.44 


424 . 18 


421.79 


.80 


11.78 


.8 


427.10 


428.35 


431.15 


424.42 


422.52 


.90 


8.01 


. 7 


427.65 


425.72 


430.77 


424.72 


423.46 


1.02 


6.27 


.6 


428.37 


422.20 


430.27 


425.13 


424.71 


1.19 


9.10 


1.0 


455.73 


457.79 


458.31 


456.39 


450.29 


.75 


6.21 


.9 


456.28 


456.10 


457.76 


456.33 


450.72 


.83 


4.58 


• 8 


456.98 


453.98 


457.08 


4S6.26 


451.25 


.94 


4.98 


.7 


457.87 


451.26 


456.21 


456 . 16 


451.94 


1.07 


9.31 


.6 


459.06 


447.63 


455.04 


456.03 


452.86 


1.25 


21.32 


1.0 


477.82 


480.45 


479.46 


479.28 


477.99 


.77 


1.11 ## 


.9 


478.57 


479.14 


478.86 


479.02 


478.26 


.86 


.10** 


.8 


479.50 


477.51 


478.10 


478.69 


478.61 


.96 


.57" 


.7 


480.70 


475.41 


477.13 


478.27 


479.05 


1.10 


3.90 


.6 


482 . 30 


472.61 


475.84 


477.70 


479.64 


1.28 


12.89 


1.0 


498.32 


502.18 


503.10 


499.97 


495.41 


.83 


5.37 


.9 


499.17 


500.14 


502.78 


499.64 


496.44 


.93 


2.52 ## 


.8 


500.23 


497.58 


502.38 


499.23 


497.72 


1.04 


2.28** 


.7 


501.60 


494.30 


501.86 


498.69 


499 . 37 


1.19 


7.14 


.6 


503.43 


489.92 


501.17 


497.98 


501.57 


1.39 


22.06 


1.0 - 


525.91 


532.06 


522.13 


527.22 


525.68 


.83 


8.54 


.9 


52?. 03 


530.35 


522.60 


526.51 


526.46 


.92 


4.75 


.8 


528.44 


528.22 


52^.19 


525.63 


527.43 


1.03 


3.87 


* .7 


530.25 


525.49 


52 3.96 


524.49 


528.68 


1.18 


8.80 


.6 


532.66 


521.84 


524.97 


522.97 


530.34 


1.38 


25.31 



1.0 
.9 
.8 
.7 
.6 

1.0 
.9 
.8 
.7 
.6 

1.0 
.9 
.8 
.7 
.6 

1.0 
.9 
.8 
.7 
.6 

1.0 
.9 
.8 
.7 
.6 

1.0 
.9 
.8 
.7 
.6 



371.98 
372.10 
372.25 
372.44 
372." 

418.76 
419.08 
419.48 
420.00 
420.68 

465.90 
466.20 
466.59 
467.09 
467.75 

504.74 
505.46 
506.35 
507.49 
509.02 

535.95 
536.55 
537.30 
538.25 
539.53 

574.16 
574.56 
• 575.06 
575.71 
576.56 



Adjusted Croup Means ■* Math 



372.88 
371.77 
370.39 
jt>8.62 
366.25 

425.92 
424.35 
422.38 
419.86 
416.48 

467.04 
465.51 
463.59 
461.13 
457.85 

502.88 
501.15 
498.97 
496 . 18 
492.46 

537.27 
534.95 
532.06 
528.33 
523.37 

574.67 
572.91 
570.71 
567.88 
S64.12 



377.94 
376.88 
375.56 
373.87 
371.61 

424.86 
423.70 
422.25 
420.39 
417.90 

462.08 
460.96 
459.54 
457.73 
455.31 

490.11 
488.92 
487.43 
485.52 
482.97 

536.48 
536.23 
535.90 
535.49 
534.94 

566 .04 
566.55 
567.19 
568.00 
569.09 



362.88 
363.39 
364.02 
364.83 
365.92 

415.48 
415.89 
416.39 
417.04 
417.91 

459.45 
459.80 
460.24 
-460.81 
461.56 

500 . 76 
501.01 
501.33 
501.74 
502.28 

531.88 
532U2 
532.42 
532.81 
533.33 

566.49 
5S6.52 
566.55 
566.60 
566.66 



358.87 
359.15 
359.49 
359.94 
360.53 

411.41 
411.92 
412.55 
413.35 
414.43 

459.84 
460.37 
461.03 
461.87 
463.00 

499.02 
499.47 
500.02 
500.74 
501.70 

527.98 
528.53 
529.21 
530.10 
531.28 

563.41 
563.99 
564.72 
565.66 
566.92 



.68 
.75 
.85 
.97 
1.13 

.72 
.80 
.90 
1.03 
1.20 

.71 
.79 
.89 
1.02 
1.19 

.78 
.87 
.97 
1.11 
1.30 



.78 
.86 
.97 
1.11 
1.30 

.78 
.87 
.98 
1.12 
1.31 



41.11 
35.79 
30.35 
25.24 
21.56 

19.83 
14.67 
9.77 
5.89 
4.69 

8.75 
7.29 
6.72 
7.94 
12.77 

10.04 
11.86 
15.59 
22.68 
35. BJ 

8.52 
6.71 
6.31 
8.69 
16.58 

14.23 
11.82 
10.03 
' 9.66 
12.44 



# T«*t of equality of slopes among the groups shows significant differences at .01 level In all cases. 
••Adjusted group means do not differ significantly among the groups at .01 level. 



ERIC 



303 



332 



Table B3-5 

Mean Reading and Math Achievement Scores and Within-Group Regressions of Posttest on Pretest 
Scores for the Three Groups of CE Students and a Comparison Group of Needy Non-CE Students 



Title I Others CE Students CoBtparison 

Grade Students in Students in in Other-CE gtoud* 

Title I Schools Title I Schools Schools P 



Reading 



Grade 1 


tl 


2,785 


987 


574 


342 


Pall (Pretest) 


Mean 


323.73 


337.21 


336.03 


316.67 


Spring (Posttest) 


Mean 


382.96 


396.81 


390.21 


366.55 


Within-Group Slope 




.75 


.94 


.80 


.62 


Grade 2 


N 


3.036 


948 


704 


458 


Fall (Pretest) 


Mean 


380.63 


405.50 


387.82 


373.42 


Spring (Posttest) 


Mean 


423.30 


446.81 


433.78 


410.58 


Within-Group Slope 




.70 


.84 


.70 


.54 


Grade 3 


N 


3,022 


o«J4 


629 


404 


Fall (Pretest) 


Mean 


415.43 


442.48 


428.67 


411.72 


Spring (Posttest) 


Mean 


450. 74 


473.04 


463.22 


438.4 5 


Within-Group Slope 




.73 


.81 


.77 


.54 


Grade 4 


N 


2,392 


864 


619 


375 


Fall (Pretest) 


Mean 


439.74 


463.73 


455.53 


431.68 


Spring (Posttest) 


Mean 


471.09 


492.20 


484.89 


463.64 


Within-Group Slope 




.70 


. 90 


78 


■ / J 


Grade 5 


N 


2,227 


802 


587 


381 


Fall (Pretest) 


Mean 


465.46 


496.68 


478.11 


-457.78 


Spring (Posttest) 


Mean 


490. 65 


520.57 


505. 99 


481.67 


Within-Group Slope 




- ' y 


• 


. 84 


79 


Grade 6 


N 


1.982 


905 


620 


369 


Fall (Pretest) 


Mean 


489.77 


520. 53 


496.84 


477. 52 


Spring (posttest) 


Mean 


515-78 


547.38 


517.86 


500.86 


Within-Group Slope 




78 


. 92 


.84 


.74 








Math 






Grade 1 




1,598 


855 


329 


539 


Fall (Pretest) 


Mean 


309-33 


325.62 


324.98 


304.23 


Spring (Posttest) 


Mean 


370. 90 


382.82 


387.44 


349.18 


Within-Group Slope 




.73 


.70 


.89 


. 55 


Grade 2 


r; 


1.686 


808 


291 


608 


Fall (Pretest) 


Mean 


362.41 


386.12 


380.94 


360.36 


Spring (Posttest) 


Mean 


415.87 


440. 09 


435.30 


405.67 


Within-Group Slope* * 




.70 


.77 


.88 


.71 


Grade 3 


N 


1,793 


768 


369 


589 


Fall (Pretest) 


Mean 


407.76 


431.02 


425.93 


402.74 


Spring (Posttest) 


Mean 


463.12 


480.82 


472.24 


450. 16 


Within-Group Slope 




-69 


.73 


.99 


.55 


Grade '4 


N 


1,434 


845 


373 


601 


Fall (Pretest) 


Mean 


444. 94 


473.26 


466. 94 


441.77 


Spring (Posttest) 


Mean 


498.32 


518.52 


500.82 


489. 54 


Within-Group' Slope 




.74 


.88 


.79 


.76 


Grade 5 


M 


1,331 


768 


400 


732 


Fall (Pretest) 


Mean 


486.74 


520.44 


496. 61 


484.11 


Spring (Posttest 


Mean 


530. 59 


558.12 


538.79 


517.79 


Within-Group Slope 




.73 


.87 


.81 


.83 


Grade 6 


N 


1,134 


858 


457 


649 


Fall (Pretest) 


Mean 


526. 54 


551.31 


525.29 


515.21 


Spring (Posttest) 


Mean 


570. 57 


590. 50 


561.47 


550. 48 


Within-Group Slope 




.72 


.88 


.84 


.85 



*This comparison group comprises non-CE students who were judged to be in need of reading (math) 
CE and attended non-CE schools with high concentrations of reading (math) low-achieving students 
and free-meal participants, 
"slopes do not differ significantly among the groups at .01 Itvel. 
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Table B3-6 

ANCOVA of Reading and Hath Achievement Scores for the Three Groups of Reading tMath) CE student a and 
a Comparison Group of Needy Non-CE Students, with Unreliability Corrections for Pretest Scores 



CE Status 







Title I 


Other -CE 


CE Students 




Cceaoon 




Grade 


heiiaDiiicy 


bcuoencs in 


Students in 


in Other-CE 


Comparison 


Regression 


F 




Estimate 


Ticie x scnoois 


Title I Schools 


Schools 


Group* 


Coefficient 










Adjusted Group Means - Reading 








a 


* 1.0 


385.97 


389. 22 


~383. 54 


375.12 


.79 


14.33 




.9 


386.31' 


388 . 38 


382.81 


376.06 


.87 


12.05 




.8 


386.73 


387.32 


381.88 


377.25 


.98 


10.39 




.7 


387.26 


385.97 


380.69 


378.78 


1.12 


10.17 




.6 


387.98 


384.16 


379.11 


380.82 


i.:i 


13.01 


2 


1.0 


426.83 


432.52 


432.16 


419.28 


.72 


19.64 




.9 


427.22 


430.93 


431.98 


420.25 


.80 


13. 54 




.0 


427.71 v 


428.94 


431.75 


421.45 


.90 


8.67 




.7 


428.34 


426.39 


431.46 


423.01 


1.02 


6. 56 




.6 


429.18 


422.99 


431.07 


425.08 


1.19 


10.49 


3 


1.0 


455.37 


457.52 


457.99 


445.85 


.75 


14.65 




.9 


455.89 


455.80 


457.41 


446.67 


.83 


11. 26 




.8 . 


456.53 


451.64 


456.69 


447.70 


.93 


10.45 




.7 


457.36 


450.87 


455.76 


449. 02 


1.06 


14.73 




.6 


458.46 


447.18 


454.51 


450.79 


1.24 


28.99 


4 


1.0 


476.11 


478.60 


477.66 


474.91 


.78 


1.41** 




.9 


476.67 


477.09 


476.86 


476.16 


.86 


.•06** 




.8 


477.36 


475.20 


475.85 


477.73 


.97 


. 92** 




.7 


478.26 


472.78 


474. 56 


479. 74 


1.11 


5. 94 




.6 


479.45 


469.54 


472.84 


482.42 


1.29 


18. 96 


5 


1.0 


496.85 


500.61 


501^59 


494.30 


.84 


5.79 




.9 


497.53 


498.39 


501.10 




. 93 


2. 30** 




.8 


498. 39 


495.61 


500.48 


497.46 


1.05 


2.40** 




.7 


499. 50 


492.05 


499.70 


499.71 


1.20 


9.32 




.6 


500.97 


487. 29 


498.65 


502.72 


1.40 


29. 25 


6 


1.0 


521.73 


527.74 


517.92 


517.00 


.83 


13.08 




.9 


522.39 


525.56 


517.92 


518. 79 


. 92 






• 8 


523. 21 


522.83 


517.93 


521.03 


1.04 


3.89 




.7 


524. 28 


519. 32 


517.94 


523.91 


1.19 


7.32 




.6 


525.69 


514.64 


517.96 


527 . 76 


1.39 


23.53 




i 




Adjusted Group Means - Math 








1 


1.0 


374.37 


374.78 


379.86 


356.25 


.71 


43.27 




.9 


374.76 


373.89 


379.02 


357.04 


.78 


38.85 




.8 


37 5.24 


372.77 


, 377.97 


358.02 


.88 


34.42 




.7 


37 5.86 


371.34 


376.S1 


359.28 


1.01 


30.54 




.6 


376.69 


369.43 


374.81 


360.97 


1.18 


28.33 


2 


1.0 


420.93 


427.66 


426.69 


412.26 


.74 


19.53 




.9 


421.50 


426.27 


425.73 


412.99 


.82 


14.52 




.8 


422.20 


424.55 


424.54 


413.90 


.92 


9.97 




.7 


423.11 


422.33 


423.00 


415.08 


1.05 


6.80 




.6 


424.31 


419.37 


420.95 


416.65 


1.23 


6.91 


3 


1.0 


467.53 * 


468.53 


463.60 


458.18 


.72 


9.44 




• 9 


468.02 


467 . 16 


462.64 


459. 07 


.80 


8. 21 




.8 


468.64 


465.45 


461.44 


460.18 


.90 


8.10 




.7 


469.42 


463.25 


459.90 


461.61 


1.03 


10.17 




.6 


470.47 


460.33 


457.84 


463.52 


1.20 


16.51 


4 


1.0 


505.51 


503.23 


490.56 


499.26 


.79 


13.31 




.9 


506.31 


501.54 


489.41 


LJ0.34 


.88 


15.86 




.8 


507.31 


499.41 


487.99 


501.69 


.99 


21.06 




.7 


508.60 


496.68 


486.16 


503.43 


1.13 


30.82 




.6 


510.31 


493.04 


483.71 


505.74 


1.32 


48.60 


5 


1.0 


537.53 


537.98 


537.80 


526.85 


.80 


12.14 




.9 


538.30 


535.74 


537.69 


527.85 


.89 


10.08 




.8 


539.26 


532.94 


537.55 


529.11 


1.00 


10.11 




.7 


540. 50 


529.34 


537.38 


530.73 


1.15 


14.15 




.6 


542.15 


524. 55 


537.14 


532.89 


1.34 


25.90 


6 


1.0 


574.09 


573.75 


566.0: 


563.27 


.82 


10.92 




.9 


574.48 


571.89 


566. 51 


564.69 


.91 


8.03 




.8 


574.97 


569.57 


567.14 


566.47 


1.02 


6.50 




.7 


575.59 


566.58 


567.95 


568.75 


1.17 


7.79 




.6 


576.43 


562.59 


569.03 


571.80 


1.36 


14.85 



CE and attended non-CE schools with high concentrations of reading (math) low-achieving students 
and free-meal participants. 

•Adjusted group means do not differ significantly among the groups at .01 level. 



ERIC 



305 



324 



In the last set of analyses, the equality of within-group slopes is insigni- 
ficant in grades 4 to .6 for reading and in grades 2 and 4 through 6 for math* 
The supplementary information and t^e ANCOVA results for this set of analyses 
are presented in Tables B3-7 and B3-8. The data in Table B3-7 show that in 
the grades where the equal-slope assumption is not met, the differences in 
pretest mean^ among the three' groups are modest. Consequently, the F-tests. 
for the differences in adjusted group means can still be referenced to assess 
the effects of CE. Disregarding the significances of unequal within-group 
regressiorfs , we find from Table B3-8 that consistently greater gains for CE 
students are obtained in grades 1 through 3 for reading and for all grades 
but grade 4 for math. (In grade 3, this finding applies when the pretest 
reliability is greater than .8. Judging from the data presented in Table 
1-15 of Report 9, the reliability for the math pretest in this grade is in 
the vicinity of .7 to .8.) Our conclusion is that de&gite the violations of 
the assumption, the ANCOVAs, in effect, give similar results as in the pre- 
vious ANOVAs, and their findings do not contradict the findings of the norm- 
referenced analyses: Title I students do better than if they were not in the 
program, but not?well enough to catch -up. 

In closing , we comment that examination of the within-group regression coef- 
ficients in Table B3-3 indicates that the significant inequality of slopes 
mostly reflects the steeper slope for other-CE students in Title I schools. 
In light of the pattern of differences in slopes among the groups, one may 
consider reanalyses of the data using only Title I students and the two non-CE 
comparison groups. However, we have no great expectation for the findings in 
these revised^ analyses to be very different from those presented in Table 
B3-8, as Title I students generally dominate the group of CE students. 

Analysis for Practical Achievement. 

The results of the analyses for practical achievement scores are tabulated in 
Tables B3-9 to B3-16 for grades 4 through 6 (the three grades at which the 
practical achievement scale was administered. A brief summary of the findings 
from these analyses is provided in the text. 

Analysis for Student's Attitudes Toward Learning and School 

The results of the analyses for student affect scores are presented in 
Tables B3-17 through B3-24, while the findings from these analyses are sum- 
marized in the text. 
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Table B3-7 



Mean Reading and Math Achievement Scores and Within-Group Regressions of Posttest on 
Pretest Scores for CE Students and Two Comparison Groups of Needy Non-CE Students 



Grade ^ Weedy Non-CE Needy Non-CE 

CE Students Students in Students in 

CE Schools Non-CE Schools 



Reading 



Grade 1 


N 


A t 346 


1 QQQ 

1 1 777 


541 


Fall (Pretest) 


Mean 


328.29 


323.35 


321.99 


Spring (Posttest) 


Mean 


386.93 


378.18 


374.78 


Within-Group Slope 




an 
. oU 




. 62 












Grade 2 


H 


A COO 

** f boo 


1 , 57 2 


678 


Fall (Pretest) 


Mean 


386.60 


332.50 


377.55 


Spring (Posttest) 


Mean 


429.50 


4*22.28 


415.96 


Within-Group Slope 




.7 5 


' T "5 
• / 4 


. 5ft 


Grade 3 


u 
« 


4 1 535 


l f 473 


591 


Fall (pretest) 


Mean 


422.41 


422.83 


416.96 


Spring (Posttest) 


Mean 


456.69 


456.94 


446.45 


Within-Group Slope 




.76 


.75 


.62 


Grade 4 


N 


3,875^ 


1,729 


G13 


Fall (Pretest) 


Mean 


447.50 


451.55 


445.25 


Spring (Posttest) 


Mean 


477 . 89« 


481 ■ 6b 


47 5 . 5 1 


Within- Group. Slope * 




.78 


.73 


-.81 


Grade 5 


N 


3,616 


1*899 


548 


Fall (pretest) 


Mean 


474.33 


<78.23 


463.57 




Mean 


499.67 


7 / 


AQC 1 1 

•Job. 1 / 


WitHfoj&pup Slope * 




.85 


.82 


.83 


Grade t^^^ 


N 


3, 507 


2,124 


* 676 


Fall (PreWst) 


Mean 


498.84 


„ 509.73 


493.57 


Spring (Pewit est) 
■WiiMn- Gropes lope 


Mean 


524.19 


533 . 61 


31o. r 1 






.81 


.82 






Math 






Grade 1 




2,782 


1, 599 


1,051 


Fall (Pretest) 


Mean 


316.10 


" 304.20 


307.25 


Spring (Posttest) 


Mean 


376.43 


358.33 


356.38 


witnin (jioup slope 




1 A 


. 61 


. 56 


Grade 2 


u 
« 


2,785 


1, 353 


If, 035 


Fall (Pretest) 


Mean 


371.14 


361.38 


360. 14 } 


Spring (Posttest) 




424.84 


411.85 


406 . 89 


Within— Group Slope * 




.76 


« / u 


.67 


Grade 3 


N 




l , J / u 


1 057 


Fall (pretest^ 


Mean 


416.05 


407.20 


404.99 


Spring (Posttest) 


Mean 


468.81 , 


456.27 


455.10 


Wi thin-Group Slope 




.74 


.71 


.59 


Grade 4 .. 


N 


2,652 


1,455 


1,169 


Fall (Pretest) 


Mean 


456.97 


450.27 


448.04 


Spring (Posttest) 


Mean 


505.02 


498.49 


495.01 


Within-Group Slope* 




.79 


.74 


.76 


Grade 5 


! 

N ' 


?,499 


1, 606 


1, 270 


Fell (Pretest) 


Mean^ 


498.59 


490.84 


487.28 


Spring (Posttest) 


Mean 


540.27 


529.69 


523.03 


Within-Group Slope* 




.80 


.74 


.78 


Grada 6 


W 


2,449 


1,767 


1,321 


Fall (pretest* 


Mean 


534.90 


530.80 


524.41 


Spring (Posttest) „• 


Maan 


575.76 


566.23 


558.14 


Within-Grou? Slope 




.81 


.75 


.77 


* 

Slopes do not differ 


significantly among the groups at 


.01 level. 
\ 
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Table B3-8 



ANCOVA of Reading and Math Achievement Scores for CE Students and Two Comparison Groups 


of Needy Non-CE Students with Unreliability Corrections for the Pretest Scores 










CE Status 










•» 




Needy Non-CE 


Needy Non-CE 


Common 




Grade 


Reliability 


CE Students 


Students in 


Students in 


Rcgr ess ion 


F 








CE Schools 


Non-CE Schools 


Coefficient 








Adjusted Group Means 


» Read ing 






1 


1.0 


385.50 


380.41 


376.03 


.74 


21.86 


.9 


385.34 


380.66 


378. 39 


.82 


18.64 




.8 


385. 14 


380.97 


376.64 


.93 


15.06 




,7 


384*88 


381. 37 


379.42 


1.06 


10.83 




.6 


384.54 


381.90 


360.19 


1.24 


6. 30 


2 


1.0 


428.18 


423.94 


421.21 


.72 


18.51 




.9 


428.04 


424. 13 


421 .79 


.81 


15.39 




.8 


427.85 


424. 36 


422. 5i 


.91 


11.59 




k 7 


427.62 


424.65 


423.46 


1.04 


7.52 




.6 


427.30 


425.05 


424.71 


1.21 


1. 54* 


3 


1.0 


456.39 


456.33 


450.24 


.75 


9.82 




.9 


456. 36 


456.26 v 


4 50 . 67 


. 84 


8.48 




.8 


456 . 32 


456. 17 


451.20 


.94 


6.80 




1 7 


456. 26 


456.06 


451.87 


1.07 


4.91 




. 6 


456.19 


455.92 


452.78 


1.25 


2.87* 


4 


1.0 


478.59 


K 479.22 


477.94 


.77 


.34* 




. 9 


478.67 


" 478.95 • 


478 21 


. 86 


.10* 




.8 


478.76 


478.61 


478.55 


.97 


„ .02* 




_ 7 


478.89 


478.17 


478.99 


1.10 


.26* 




. 6 


479.06 


477.60 


479.57 


1.29 


1.19* 


5 


1.0 


499.88 


499.90 


495.41 


.84 


4.20* 




. 9 


499.90 


499.56 


496.44 


.93 


2.43* 




.8 


499.93 


499.14 


497.73 


1.05 


1.11* 






499.97 


498.59 


499.38 


1.20 


.98* 




.6 


500.02 


497.86 


501.58 


1.40 


3.50* 


6 


1.0 


526.77 


527.12 


525.68 


.83 


.44* 




.9 


527.06 


526.40 ' 


576.46 


.93 


.27* 




.8 


■ 527.42 


525.50 


527.43 


1.04 


2.14* 




.7 


527.88 


524.34 


528.68 ' 


1.19 


7.92 




.6 


528.49 


522.79 


53C.34 


1.39 


21.40 



Adjusted Group Means - Hath 



1 



3 



4 



5 



6 



1.0 


372.88 


362.88 


358.86 


.68 


77.80 


.9 


372.48 


363.39 


359.13 


.76 


68.36 


.8 


371.99 


364.02 


359.47 


.85 


57.25 


.7 


371.36 


364.83 


359.92 


.97 


44.87 


.6 


370.51 


36S;92 


360.51 


1.13 


31.69 


1.0 


421.3b 


41>.51 


411.45 


.73 


28.79 


.9 


420.96 


415.91 


411.96 


.81 


23.33 


.3 


420.50 


4 416.42 


U2.60 


.91 


17.28 


.7 


419.88 


* 417.07 


4)3.41 


1.04 


10.99 


.6 


419.05 


417.95 


414.50 


1.22 


5.22 


1.0 


465.65 


459.41 


459.81 


.71 


15.35 


.9 


465.30 


459.76 


460.33 


.79 


11.78 


.8 


464.86 


460.20 


460.98 


.89 


7.89 


.7 


464.29 


460.76 


461.82 


1.02 


4.11* 


.6 


46? . 54 


461 . 50 


462.94 


1.19 


1.19* 


1.0 4 


502.06 


500.71 


498.96 


.77 


2.20* 


.9 


501.73 


500.96 


499.40 


.86 


1.23* 


.8 


501.32 


501.27 


499.94 I 


.97 


.AC* 


.7 


500.79 


501.66 


500.65 


..10 


.25* 


.6 


500.08 


502.19 


501.59 


1.29 


1.31* 


1.0 


536.36 


1531.85 


527.95 


.78 


16.74 


.9 


535.95 


532.09 


528.50 


.87 


12.97 


■ 8, 


535.41 


532.39 


529.19 


.97 


8.89 


.7 


534.72 


532.77 


530.07 


1.11 


4.83 


.6 


533.79 


533.29 


531.24 


1.30 


1.46* 


1.0 


572.77 


566.46 


563.39 


.79 


21.79 


.9 


572.44 


566.48 


563.97 


.87 


18.18 


.8 


572.02 


566.52 


564.70 


.98 


14.15 


.7 


571.49 


566.56 


J 565.64 


1.12 


9.83 


.6 


570.77 


566.61 


566.89 


1.31 


5.56 



•Adjusted group neans do not differ significantly among the groups at .01 level. 
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n Table B3-9 

Mean Practical Achievement Scores and With in -Group Regressions of Posttest 
on Pretest" Scores for CE Students and Two Comparison Groups of Needy Non-CE Students 

n Needy Non-CE Needy Non-rCE 

Grade CE Students Students in Students in 

CE Schools Non-CE Schools 



Reading CE Status 



Grade 4 


N 




3,844 ^ 


1,730 


577 


Fall (Pretest) 


Mean 




9.65 


9.66 


9.<49 


Sorina (Posttest) 


Mean 




13.47 


13.78 


13,55 


Within-Group slope* 






.76 


.75 


.65 


Grade 5 


N 




3,592 


1,874 


521 


Fall (Pratest) 


Mean 




13.19 


13.31., 


12.48 


Spring (Posttest) 


Mean 




If .37 




J. J * DD 


Within-Group Slope* 






.75 


,71 


.72, 


Grade 6 


N 




3,486 










2,115 


637 


Fall (Pratest) 


Mean 




15.58 


16.54 


15.15 


Cr5 finer /po«ff> 


Mean 




18.59 


19,56 


18.32 


Within-Group Slope* 






79 




. / J 








Math CE Status 






Grade 4 


N 




2,636 


1,469 


1,138 


Fall (Pratest) 


Mean 




9.80 


9.00 


9.41 


Spring (Posttest) 


Mean 




13.55 


12.86 


13.16 


Within-Group Slope 






.80 


.67 


.62 


Grade 5 


N 




2,470 


;,597 


1,237 


Fall (Pretest) 


Mean 




13.31 


12.25 


12.90 


Spring (Posttest) 


Mean 




16.49 


15.61 


15.79 


Within-Group Slope 






.75 


.71 


.70 


Grade 6 


N 




2,427 


1,760 


1,290 


Fall (Pratest) 


Mean 




. 15,90 


15.41 


15.21 


Spring (Posttest) 


Mean 




18.87 


18.66 


17.96 


Within-Group Slope** 


> 




.70 


.69 


.73 



* 

Slope* do not differ significantly among groups at ,,01 level. 
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Table B3-10 * 

ANCOVA of Practical Achievement Scores for, CE Students and Two Comparison Groups 
of Needy Non-CE Students with Unreliability Corrections for the Pretest Scores 



CE status 



* 






Need^ Non-CE 


Needy Non-CE 


Common 




d 

ra e 


Reliability 


CE Students 


Students in 


Students in 


Regression 


F 


Estimate 




CE Schools 


Non-CE Schools 


Coefficient 








Adjusted Group Means - Reading CE Status 






4 


1.0 


13.47 


13.76. 


1 ? Aft 
i. J . Do 


.75 


r . 39* 






13.46 


13.76 


13.67 


.83 


2.41* 




. 8 


13.46 


13.76 


13.69' 


.94 * 


2.44* 




.7 


13.46 


13.76 


13.70 


1.07 


2.49* 




.6 


13.46 


13.75 


13.73 




2. 56* 


' 5 


1.0 


16.35 


16.54 


16.06 


.73 


2.09* 




.9 


16.35 


16.52 


16.11 


.82 


1.62* 




o 

.8 


16.34 


16.51 


16.18 


.92 


1.12* 




. / 


16.34 


16.49 


16.27 


1.05 


.66* 




.b 


16.34 


16.46 


16.39 


1.22 


. 36* 


6 


1.0 


18.78 


19.08 


18.83 


.71 


2.55* 




.9 


18.81 


19.03 


18.88 


.78 


1.26* 




o 
• o 


18.83 


18.96 


18.95 


QQ 
• OO 


At* 




• / 


18.87 


18.87 


19.04 


1 • 01 


• J** w 




c 
« O 


18.92 


18.76 


19.16 


1.18 


±, w 






Adjusted Group Means - Math 








4 


i n 

l.U 


13.32 


13.23 


13.22 


"7 A 


• z / * 




A 

.9 


13.29 


13.27 


13.22 


• 82 


• 09* 




.8 


13.26 


13.32 


13.23 


. 92 


.11* 




. 7 


13.22 


13.38 


13.24 


1. 06 


. 53* 




c 
• O 


13.17 


13.47 


13.26 


1. z J 


1 • / 5 


5 


1.0 


16.19 


16.08 


15.78 


.73 


2.72* 




.9 


16.15 


16.14 


15.78 


.81 


2.61* 


r 


.8 


16.11 


16.20 


15.78 


.91 


2.75* 




• 7 


16.06 


16.29 


15.78 


1.05 


3.58* 




.6 


15.98 


16.40 


15.78 


1.22 


5.82 


6 


1.0 


18.64 


18.78 


18.22 


.70 


5.14 




.9 


18.62 


18.79 


18.25 


.73 


4.69 




.8 


18.59 


18.81 


18.29 


.87 


4.26* 




.7 


18.55 


18.83 


18.33 


1.00 


4.00* 




.6 


18.50 


18.85 


18.39 


1.17 


4.14* 



* Adjusted group means do not differ significantly among groups at .01 level. 
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Table B3-11 

Mean Practical Achievement Scores and Within-Group Regression of 
Posttest, on Pretest Scores by CE status 



Grade 



Title I 
Students in . 
Title I Schools 



o Other-CE 

Students in 
Title 1 Schools 



CE Students 
in Other-CE 
Schools 



Non-CE Students 
in Title I 
Schools* 



Kon-CE students students in 
in Otfier-CE Non-CE 
Schools* Schools* 



Orade 4 ~ 

Ml (Pretest) * 
Spring (Posttest) 
•ithin-cro*, slop. 

Grade S 

fall (Pretest) . 
Spring (Posttest) * 
Within- Group Slope** 

Grade 6 

Pall (Pretest) 
Spring (Posttest) 
Within- Group Slope 



Reading CE Status 



n 


2,367 


868 


609 




1,876 


941 


544 


Mean 


9.17 
.68 


10.38 
14.57 
.90 


10.48 
14.02 
.76 




14.75 
19.11 
.75 


15.69 
19.76 
.73 


13.85 
18.43 
, -74 


H 


2,218 


798 


576 




1,989 - 


1,032 


635 


Mean 
Mean 


12.39 
15.55 
.72 


14.90 
18.36 
.76 


13.89 
16.80 
.75 




18.67 
21.58 
.71 


19.78 
22.86 
.68 


18.32 
21.39 
.65 


N 


1,979 


894 


613 




* 1,980 


1,700 


731 


Mean 
Mean 


14.94 
17.92 
.69 


17.05 
20.01 
.76 


15.54 
18.72 
.73 




21.52 
23.79 
.65 


22.08 
24.12 
.62 


2C56 
22.82 
•7i) 



Math CE Status 



Grade 4 

Fall (Pretest) 
k Spring ' (Posttest) , 
With in- Group slope 

Grade 5 

Fall (Pretest) 
Spring (Posttest) 
Within-Group Slope 

Grade 6 

Pall (Pretest) 
Spring (Posttest) 
Within-Group slope 



*A random sample was selected from all non-CE 
do not differ significantly aaorig the 



N 


1,426 


844 


366 


2,173 


968 


561 


Mean 
Mean 


8.83 
12.53 - 
« -67 


10.91 
14.96 

* .90 


11.01 
14.26 
.82 


13.87 
18.26 
.73 


15.62 
19.48 
.76 


13.17, 
17.75 
.78 


N 


1,321 


757 


392 


2,254 


1,107 


643 


Mean 
Mean 


12.13 
15.32 
.68 


15.18 
18.43 
.77 


13.67 
16.73 
.80 


18.00 
20.96 
.73 


19.19 
22.40 
.69 


17.77 
20.96 
.66 


N 


1,138 


839 


450 


2,272 


1,705 


743 


Mean , 
Mean 


15.01 
17.92 
.64 


17.33 
20.16 
.75 


15.50 
18.89 
.68 


20.65 
22.97 
.70 


21.63 
23.67 
•6? 


20.40 * 
22.72 
.67 
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students to supply the data for these* groups, 
six groups at .01 level. 
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Table B3-12 

ANCOVA of Practical Achievement Scores for the Six Groups of CE Students with 
Unreliability Corrections for the Pretest Scores 



D Reliability 
£ Estimate 



Title I 
Students in 
Title I Schools 



1.0 
.9 
.8* 
.7 
.6 

1.0 
•9 
.8 

•7' 
.6 

1*0 
.9 
.8 
•7 
• 6 



ERLC 



1.0 
.9 
.8 

.7 
.6 

1.0 
.9 
.8 
.7 
.6 

1.0 
.9 
.8 
.7 
.6. 



CE Status 



Other -CE 
Students in 
Title I Schools 



CE Students 
in Other -CE 
Schopls 



Non-CE Students 
in Title I 
Schools* 



Non-CE Students Student^ in 
in Other-CE Non-CE 
Schools* Schools* 



15.12 
15.36 
15.67 
16.06 
16.58 

18.17 
18.46 
18.83 
19.29 
19.92 

20.64 
20.95 
21.33 
21.81 
22.46 



Adjusted Group Means - Reading CE Status 



15.85 
15.99 
16.17 
16.39 
16.70 

19.19 
19.29 
19.40 
19.55 
19.75 

21.29 
21.44 
21.62 
21.85 
22.15 



15.22 
*15.35 
15.52 
15.73 
16.02 

18.36 
18.53 
18.75 
19.03 
19.40 

21.03 
21.24 
21.61 
22.02 
22.57 



17.12 
16.89 
16.62 
16.26 
15.78 

19.74 
19.53 
19.28 
18.95 
18.51 

22.02 
21.83 
21.58 
21.27 
20.85 



Adjusted Group Means - Math CE Status 



15.23 


16.08 


15.31 


17.13 


15.53 


16.20 


15.43 


17.01 


15.90 


16.36 


15.57 


16.85 


16.38 


16.56 


15.76 


16.65 


17.03 


16.83 


16.01 


16.38 


18.38 


19.30 


18.68 


19.80 


18 J7 2 


19.39 


18.90 


19.68 


19.15 


19.51 


19.17 


19.52 


19.70 


19.67 


19. 52 


19.31 


20.43 


19.88 


19.99 


19.03 


20.82 


21.47 


21.45 


22.01 


21.14 


21.62 


21.74 


21.90 


21.54 


21.80 


22.09 


21.77 


22.06 


22.03 


22.55 


21.6a 


22.75 


22.35 


23.16 


21.37 



3JJ 



random sample was 
Justed group means 



selected from all non-CE students; to supply the. data^for these groups, 
do not differ significantly among the six groups at .01 level* 



Common 
Regression F 
Coefficient 



17.06 


17.11 


.75 


47.95 


16.76 


16.96 


.83 


27.57 


16.38 


16.77 


.94 


11.15 


15v90 


16.54 


1.07 


3.23 


15.25 


16.22 


1.25 


11.18 * 


20.24 


19.80 


* .tl 


36.56 


19.95 


19.62 


.79 


17 .94 


19. 58 


19.40 


.89 


4.87 


19.11 


19.12 


1.01 


2.24** 


18 . 49 


18 . 74 


1 . lb 


lb . 


21.97 


21.71 


.68 


22.50 


21.74 


21-. 58 


.76 


7.92 


21.44 


' . 21.43 


.85 


1.00** 


21.05 


21.23 


.98 


7.25 


20.54 


20.96. 


1.14 


35.61 


1/ • Ul 


17 . 15 


76 


34.96 


ID./** 


17 . 08 


.85 


21. 26 


16 40 


17 . 00 


.95 


10.35 


15.96 


16.89 


1.09 


5.76 


15.37 


16.75 


1.27 


13.48 


20.39 


19.97 


.72 


25.81 


20.17 


19.86 


•80 


12.60 


19.89 


19.72 


.90 


3.18 


19.53 


19.54 


1.03 


1.32** 


19.05 


19.31 


1.20 


13 f 70 


22.03 


21.93 


.68 


13l06. 


21.85 


21.84 


.76 


4.71 


21.62 


21.73 


.86 


1.32** 


21.33 


21.59 


.98 


7.00 


20.94 


21.40 


1.14 


28.86 



0 



Table B3-13 , 

Practical Achieve pent Scores end Within-Group Regressions of Posttest 
on Pretest Scores for the Three Groups of CE Students and Two 
Comparison Groups of Needy Non-CE Students 



Grade 



Title I 
Students 
in Title I 

Schools 



Other-CE 
Students 
in Title X 
Schools 



CE Students 
in Other-CE 
Schools 



Needy Non-CE 
Students in 
CE- Schools 



Needy Non-CE 
Students ( 
in Non-CE \ 
Schools 



Grade 4 

Fall '(Pretest) 
Spring (Posttest) 
Within-Group Slope 

* Grade S 

Ml (Pretest) 
Spring (Pvsttest) 
Within-Group Slope * 

Grade 6 

rail. (Pretest) 
Spring (Posttest) 
Within-Group Slope * 







Reading CE Status 








N 


2,367 


868 


609 


1,730 


577 


Mean 


9.17 


10.38 


10.*48 


S.66 


9.49 


Mean 


12.93 


14.57 


14.02 


13.78 


13.55 




.68 


.90 


.76 


..75 

« 


. .65 


N 


2/218 


798 


576 


1,874 


521 


Mean 


12.39 


14.90 


13.89 


13.31 


12.48 


Mean 


15.55 


18.36 


16.80 


16.65 


15.55 




.72 


.76 


.75 


.71 


.72 


N 


1,979 


894 


613 


2,115 


637 


Mean 


14.94 


17.05 


15.54 


16.54 


15.15 


Mean 


17.92 


20.01 


18.72 


19.56* 


18.32 


.69 


.76 


.73 


.67 


.73 



Math CE Status 



Grade 4 N 

Pall (Pretest) - Mean 

Spring (Posttest) Mean 
Within-Group slope 

Grade S N 

Pall (Pretest), Mean 

Spring (Posttest) Mean 
Within-Group slope* 

Grade 6 M 

rail (Pretest) Mean 

Spring (Posttest) Mean 
Within-Group Slope* 



1,426 

8.83 
12.53 
.67 

1,321 

12.13 
15.32 
.68 

1,138 

15.01 
17.92 
.64 



844 


366 




1,469 


1,138 


10.91 


11.01 




9.00 


9.41 


14.96 


, 14.26 




12.86 


13.16 


.90 ^ 


,.<2 




.67 


.62 


757 


392 




1,697' 


1,237 


15.18 


13.67 




12.25 


12.90 


18.43 


16.73 




15.61 


15.79 


.77 


.80 




.71 


.70 


839 


450 




1^760 


1,290 


17.33 


15.50 




15.41 


15/21 


20.16 


18.89 




18.66 


f 17.96 


.75 


.68 




.69 


.73 



'slopes do not differ significantly anong the analysis, groups at .01 level. 



/ 



342 



313 



Table B3-14 



ANCOVA of Practical Achievement Scores for the Three Groups of CE Students and Two Comparison 
Groups of Needy Non-CE students with Unreliability Corrections for the Pretest Scores 









CE Status 








Reliability 
Grade ^ JT * Y 


Title I 

otuucnts 

1 n 'P^ fin T 
111 llblC A 

Schools 


Other-CE 
Students • 
in Title I 
Schools 


CE Students 
in other-CE 
Schools 


Neegy Non-CE 
Students in 
CE -Schools 


Needy Non-CE 
Students 
in Non-CE 
Schools 


Coefficient 


F 






Adjusted Group Means - Reading CE Status 








4 1.0 


13 .28 


14.02 


13.39 


13.76 


13 .66 


75 




.9 • 


13.32 


13.95 


13.32 


13.76 


13 .67 


.83 


4.10 


.8 


13.37 


13.88 


13.23 


13.76 


13.68 


.93 


3.40 


.7 


13.44 


13.78 


13.12 


13.76 


13.70 


1.07 


2.99* 


.6 


* 13.52 


13.65 


12.97 


13.75 


13.73 


1.24 


3.30* 


5 1.0 


16.12 


17.09 


16.28 


16.54 


16.05 


.73 


6.67 


■* 9 




16.95 


16.22 


16.53 


i & ii 

ID . X± 


Q1 


A A £ 
H .HO 


.8 


16.26 


16.78 


16.15 


16.51 


16.18 


.91 


2.46* 


.7 


16.36 


16.55 


16.05 


16.49 


16.27 


1.04 


1.20* 


.6 


16.49 


16.25 


15.93 


16.47 


16. 39 


1.21 


1.72* 


6 1.0 


18.57 


19.18 


18.94 


19.08 


18.82 


.70 


3.89 


J '* 


18.64 


19.09 


18.97 


19.03 


18.88 


.78 


2.10* 


f .8 


, 18.73 


18.97 


19.00 


18.96 


18.95 


.88 


.78* 


•2 S 


18.85 


18.82 


19.04 


18.88 


19.04 


1.00 


.38* 


.6 


19.00 


18.63 


19.09 

-SB*** 


18.76 


19.16 


1.17 


2.08* 






Adjust, i Group Means - 


Math CE status 








4 1.0 


13.01 


13.92 


13.16 


13.22 


13.22 


.73 


A 99 


# 9 


13 . 06 


13.81 


13.03 


13.26 


13.22 


.81 


3.50 


.8 


13.13 


13.66 


12.88 


13.31 


13.23 


!91 


2.36* 


.7 


13.21 


13.48 


12.68 


13.38 


13.24 


1.04 


2.01* 


6 .6 


13.33 


13.23 


12.42 


13.46 


13.25 


1.22 


3.41 


in* 


15. 88 


16.77 


16.17 


16.08 


15.78 


.72 


5.22 




15 . 9 'i 


16.59 


16.10 


16.13 


15.78 


.80 


^ 32* 


.8 


16.01 


16.36 


16.03 


16.20 


15.78 


.90 


1.96* 


.7 


16.11 


16.06 


15.93 


16.28 


15.78 


1.03 


1.85* 


.6 


16.25 


15.67 


15.79 


16.39 


15.78 


1.21 


4.41 


6 1.0 


18.32 


18.94 


18.94 


18.78 


18.22 


.70 


5.06 


# 


18.36 


18.81 


18.95 


18.79 


18.25 


.77 


3.95 


.8 


18.42 


18.64 


18.96 


18.81 


18.29 


.87 


3.16* 


.7 


18.49 


18.42 


18.97 


18.83 


18.33 


.99 


3.04* 


-« ° ' S 


18.58 


18.13 


18.98 


18.86 


18.39 


1 16 


4.43 



roup means do not differ significantly among the analysis groups at .01 level. 



Table 33-15 



Mean Practical Achievement Scores and Within-Group Regressions of Posttest 
on Pretest Scores for the Three Groups of CE Students and a 
Comparison Group of Needy Non-CE Students* 



Grade 




Title I 
Students in 
Title I Schools 


Other-CE 
Students in 
Title I Schools 


CE Students 
in CMaer-CE 
Schools 


Comparison 
Group* 




$ 


Reading CE Status 






Grade 4 


M 
Li 


2,367 


868 


609 


336 


ran (pretest; 


Mean 


9.17 


10.38 


10.48 


8.60 


spring ifostte&t/ 


Mean 


12.93 


14.57 


14.02 


12. 96 


Within-Group Slope 




. 68 


. 90 


.76 


.54 


Grade 5 


N 


2/ 218 


798 v 


576 


355 


Fall (Pretest) 


Mean 


12.39 


14.90 


13.89 


12.29 


Spring (Posttest) 


Mean 


15.55 


18.36 


16.80 


15.65 


Within-Group Slope** 




. 72 


. 76 


.75 


.74 


Grade 6 


N 


1,979 


894 


613 


329 


Fall (Pretest) 


Mean 


14.94 


17.05 


15.54 


13.81 


Spring (Posttest) 


Mean 


17.92 


, 20.01 


18.72 


16.65 


Within-Group Slope** 




.69 


.76 


.73 


.67 






Math CE 


Status 






Grade 4 


M 


1,426 


844 


366 


Dj 1 


Fall (Pretest) 


Mean 


8.83 


10.91 


11.01 


8.78 


Spring (Posttest) 


Mean 


12.53 


14.96 


14.26 


12.90 


Within-Group Slope 




.67 


..90 


.82 


.55 


Grade 5 


N 


1,321 


757 


392 


702 


Fall (Pretest) 


Mean 


12.13 


15.18 


13.67 


12.69 


Spring (Posttest) 


Mean 


15.32 


18.43 


16.73 


15.48 


Within-Group Slope** 




.68 


.77 


.so ; 


.70 


Grade 6 


N 


1,138 


839 


450 


618 


Fall (Pretest) 


Mean 


15.01 


17.33 


15.50 


14.26 


Spring (Posttest) 


Mean 


17.92 


20.16 


18.89 , 


17.08 


Within-Group Slope 




.64 


.75 


.68 


.76 



*This comparison group comprises non-CE students who were judged to be in need of reading 
(math) CE and attended non-CE schools with high concentrations of reading (math) low- 
achieving students and free-meal participants. 



**Slopes do not differ significantly among the groups at .01 level. 



344 

.315 















Table 


B3-16 








• 




- 




ANCOVA of Practical Achievement Score 


for 


the Three Groups of CE Students and a Comparison 








Group of Needy Non-CE Students with Unreliability Corrections for the Pretest score* 




















CE Status 














Grade 


Reliability 
Estimate 

r 


Title I - Other-CE 
Students in Students in 
Title I Schools Title I Schools 


CE Students 

in Other-CE Comparison 
Schools Grou ** 


* .Common 
Regression 
Coefficient 




F 




r> 






Adjusted Group Means 


- Reading CE status 












4 


1.0 


13. 


23 


13 


96 




13 


.33 


13.68 




.75 


5 


.27 




. .9 


13. 


26 


13 


89 




13.26 


13. 76 




. 83 


4 


.43 




1.8 


13. 


31 


13 


81 




13 


.16 


13 .85 




. 93 


3 


.87 




.7 


13. 


36 


o 13 


70 




13 


.04 


13.98 


1 


.07 


3 


.94 




.6 


13.43 


13 


56 




12.88 


14.15 


1 


.24 


5 


.39 


5 


1.0 


16.08 


17 


04 




16 


.23 


16.25 




.74 


7 


17 




.9 


16. 


14 


16 


89 




16 


.16 


16.31 




.82 


4 


.54 




.8 


16. 


21 


16 


70 




16 


.08 


16.40 




.92 


2 


.36** 




.7 


16. 


31 


16 


47 




15 


98 


16.51 


1 


.05 


1 


.30** 




.6 


16. 


43 


16 


15 




15 


.84 


16.65 


1 


.23 


2 


81** 


6 


1.0 


18. 


27 


18 


85 




18.64 


17.81 




.72 


5 


02 




.9 


18. 


31 


18 


72 




18 


.63 


17.94 




.79 


2 


85** 




o 
. o 


18. 


36 


18 


56 




18 


.62 


18.10 




.89 


1 


13** 




•7 


18.42 


18 


36 




18 


61 


18.31 


1 


.02 




40** 




.6 


18. 


51 


18 


08 




18.58 


18.58 


1 


.19 


1 


94** 










Adjusted Group Means - Math 


CE Status 












* 4 


1.0 


13. 


11 


13 


96 




13 


19 


13 .52 




. 76 


5 


69 




.9 


13. 


18 


13 


85 




13 


08 


13.59 




.85 


4 


26 




.8 


13. 


26 


13 


72 




12 


93 


13 .68 




. 95 


3 


41** 




.7 


13. 


36 


13 


54 




12 


74 


13.79 


1 


09 


3 


82 




.6 


13. 


50 


13 


30 




12 


48 


13.94 


1 


.27 


6 


80 


5 


1.0 


16. 


08 


16 


96 




16 


36 


15.83 




.73 


7 


19 




.9 


36. 


17 


16 


80 




16 


32 


15.87 




.81 


4 


46 




.8 


16. 


27 


16 


59 




16 


27 


15.91 




91 


2 


23** 


- 


.7 


16. 


41 


16 


33 




16 


21 


15.98 


1 


04 


1 


24** 




.6 


16. 


59 


15 


98 




16 


12 


16.06 


1 


22 


3 


05** 


6 • 


1.0 


18. 


31 


18 


92 




18 


94 


18.00 




70 


5 


54 




.9 


18. 


35 


18 


79 




18 


94 


18.11 




78 


3, 


55** 




.8 

.7 


18. 
18. 


41 
48 


18 
18 


61 
39 


O sO 18 


95 
96 


18.23 
10.40 


1 


88 
00 


2 

1. 


00** 
46** 




.6 


18. 


57 


18. 


10 




18 


97 


18.62 


1 


17 


3. 


13** 


■ 


iparison group comprises non-C£ students who 


were 


judged to be in need of reading 


(math) CE and attended 


ppi/^'chools with high concentrations of reading 
^■Hg' group means do not differ significantly am. 


(math) 


low-achieving students and free-meal participants. 






png the groups at .01 level. 

\ 













Table B3-17 

Mean Student Affect Scores ana within -Croup Regressions 
of Tosttest on Pretest by Reading and Math CE Status 



Mean 
Mean 



Grade 2 

Pall (Pretest) 
Spring (Post test) 
Within -Group Slope*"' 

Grade 3 

Fall (Pretest) 
Spring (Posttest) 
Within -Group Slope* 

Grade 4 

Fall < Pretest) 
Spring, (Posttest) 
Within-Group Slope* 

Grade 5 

Fall (Pretest) 
Spring (Posttest) 
Within-Group Slope* 

Grade 6 

Fall (Pretest) 
Spring (Posttest l 
Within-Group Slope* 



Grade 2 

Fall (Pretest) 
Spring (Posttest) 
Withm-Group Slope*' 

Grade 3 

Fall (Pretest*) 
Spring (Posttest) 
Withm-Group Slope* 

Grade 4 

Fall (Pretest) 
Spring (Posttest) 
Within-Group Slope* 

Grade S 

Fall (Pretest) ■ 
Srnng (Posttest) 
Withm-Group Slope* 

Grade 6 

Fall (Pretest) 
Sprirg (Posttest) 
Within-Group Slope* 



Title I 
Students in 
Title I Schools 



Other-CE CE Students 
Students in In Other-CE 
Title I schools Schools 



Non-CE Students Non-CE Students Students 
in Title I in Other-CE in Non-CE 

Schools* Schools* Schools* 



2.748 

83.86 
85.78 
.41 



Reading CE Status 



869 

79.54 
8^.17 
.44 



651 

80.50 
81.82 
.40 



N 


2.784 


826 


593 


Mean 


84.67 


84.37" 


81.94 


Mean 


84 . 36 


83.73 


81.85 




.48 


.47 


.40 


U 


2 .206 


828 


58b 


yean 


80.54 


80.36 


78. 37 




80. fl ~> 


80.01 


78.69 






.59 


.51 




2 ,097 


■*5 3 


55S 


*ican 


81.26 


79.62 


77.20 




80.55 


77.96 


78.16 




.56 


.58 


.50 


N 


1. 867 




584 


yean 


79.99 


77.42 


74 .96 


Mean 


79 .54 


75.95 


73.81 




.65 


.68 


.66 






Math CE 


Status 


r: 


1.500 


725 


279 


yean 


85.99 


80.90 


80.25 


Mean 


87.42 


83.62 


84.45 


.40 


.41 


.42 


s 


1.651 


679 


353 


yean 


86.68 


82.69 


82.97 


yean 


86.58 


83.29 


82.07 




.4ft 


.47 


.47 


N 


I. 324 


799 


353 


yean 


81.63 


79.65 


7^.96 


Mean 


81.55 


79.27 


78.54 




.54 


.55 


.51 


N 


1.26P 


"04 


P5 


yean 


81.94 


78.77 


78.35 


Mean 


81.21 


78.66 


78.35 


.56 


.53 


.54 




1.057 


P07 


432 


Mean 


79.82 


76.83 


74.80 


yean 


80. »9 


74.56 


56 


.67 


.67 


.6b 



1 .615 


770 


503 


82 28 


81. 19 


81.95 


84.39 


82.30 


85.97 


.46 


.42 


.47 


1.650 


785 


551 


81 .98 


78.92 


80.93 


81.37 


78.95 


81.02 


.53 


.46 


.47 


1.787 




534 


78.88 


76.94 


79.55 


7C.30 


77.38 


80.30 


.58 


.53 


.58 


1 .921 


1.014 


622 


77.67 


75 .62 


79 . 14 


76.33 


74.55 


77.31 


.b3 




.<>3 


I 909 


1 .647 


723 


74.62 


72.81 


77.87 


72.73 


70 .06 


75 . «7 


. 66 


.64 


.69 


2 050 




502 


81 .67 


8 1 . 6v 


61.63 


83.79 


81.81 


84.02 


.42 


.41 


.33 


1 ,** * ' 


fi74 


553 


82. 22 




82. 33 


81.94 


79.02 


81.10 


.51 


- .49 


.50 


m . - 


) 32 


548 


79. 2 


77 .05 


78 . 56 


79 79 


77.73 


7Q.92 


.53 


.52 


.60 


2.1';4 


1. 07-* 


614 


78.88 


75. 33 


79.16 


77. "4 


75.96 


77.62 


.63 


.58 


.59 


2.!V> 


1.662 


724 


75.06 


73.56 


78.07 


72.73 


71.33 


74.90 


.63 


.61 


.70 



*A random sample vas selected froo all non-CE 
*Slopes do not differ significantly arong the 



students to supply the data for these groups. 
Si.x groups at .01 level. 



31 G 



ER?C 



317 



Table B3-18 

AKCOVA of Student Affect Scores for the six Pending (Math) 
CE Croups vith Unreliability Corrections for the Pretest Scores 



C CE Status 



R 




















— Cocacn 




A Reliability 


Title I 




Title I 


CE Students Non-CE Students 


Hon-CE Students students 


in Regression 


F 


0 


Estimate students 


in 


Students in 


In Other-CE 


in Title I 




in Other-CE 


Non-CE 


Coefficien 




E 


Title I Schools 


Title I Schools 


Schools 


Schools* 




Schools* 


Schools 


• 












Adjusted Croup Means - 


Reading CE status 








2 


1.0 


85. 10 




85.33 


82.57 


84.37 




82.75 


86. 10 


.43 


5.28 




.9 


8S.02 




85.46 


82.65 


84.37 




82.80 


86. 12 


.48 


5.05 






84.92 




85.62 


82.76 


84.37 




82 .87 


86. 14 


.53 






K 


84.80 




85.83 


82.89 


84.37 




82 .95 


86. 16 


.61 


4.64 


7 


* .6 


84.64 




86. 10 


83.07 


84.36 




83.06 


86.19 


.71 


4.61 


3 


1.0 


83. SO 




83.02 


82.31 


81.80 




60.85 


81.95 


.48 


4.45 


f 


.9 


83.40 




82.94 


82.36 


81.85 




81.07 


82.06 


.53 


3.54 




.8 


83.28 




82 .84 








81.33 


82.19 




2 .54** 




.7 


83.13 




82.71 


82.50 


81.98 




81 .67 


82. 36 


69 






.6 


82.92 




82. 54 


82.61 


82.09 




82.12 


82.5b 


.80 




4 


I. J 


80. 19 




79.45 


79.23 


79.56 




78.70 


80.19 


.55 


1.41" 




.9 


80.12 




79.39 


79.29 


79.58 




78.85 


60. 18 


.61 


1.08** 




.8 


80.03 




79.31 


79.36 


79.62 




79.04 


80. 16 


.69 


• 75** 




-7 


79.91 




79.21 


79.46 


79.67 




79.27 


80. 14 




.47** 




.6 


79.75 




79.08 


79.58 


79.73 




79.59 


80.12 


.92 


. 34** 


5 


1.0 


'9.08 




77.45 


79.08 


76.97 




76.40 


77.09 


.59 


6.74 




.9 


78.91 




77.40 m 


79.18 


77.04 




76.60 


77.06 


.65 


5.59 




.8 


78.71 




77.33 " 


79.31 


77.13 




76.86 


77.03 


.74 


4.42 




.7 


78.45 




77.24 


79.47 


77.25 




77.19 


76.99 


.84 


3.33 




.6 


78.09 




77.11 


79.69 


77.40 




77.63 


76.94 


.98 


2.79** 


6 


1.0 


77 04 




75.15 


74.63 


73.77 




72.29 * 


74.07 


.66 


18.15 




.9 


76.77 




75.06 


74.72 


73.89 




72.54 


73.94 


.73 


14.35 




.6 


76.42 




74.95 


74.83 


74.03 




72.85 


73.79 


.82 


10. 32 




7 


75.98 




74.81 


74.98 


74.22 




73.25 


73.59 


.94 


6.31 




.6 


75.38 




74.62 


75.17 


74.47 




73.78 


73.33 


1. 10 


2. 99" 










Adjusted Group Means 


- Math CE Status 








2 


1.0 


86.05 




84.31 


85.40 


84.17 




82.18 


84.41 


.40 


5.92 




-9 


85.90 




84.39 


85.51 " 


84.21 




82.22 


84.45 


.45 


5.34 




.8 


85.71 




84.48 


85.64 


84.26 




62.27 


84. 51 




4.71 




.7 


85.47 




44.60 


85.81 


84.33 




62.34 


84.58 


.58 


4.05 




.6 


85.14 




slkn 


86.04 


84.42 




82.43 


84.67 


.67 


3 .43 


3 


1.0 


84.79 




83.45 


82.09 


82-. 3 3 




81.18 


81.44 


.49 


8.04 




.9 


84.59 




83.47 


82.09 


82.38 




81.42 


81 .43 


.54 


6.53 




.8 


84.34 




8.3.49 


82.09 


82.43 






81.53 


■ 6l 


4.91 




.7 


84.02 




83.52 


82.10 


32.50 




82.11 


81 .59 




3. 25 




.»s 


83.59 




83.SC 


82.10 


82.59 




82.62 


81.67 


• 82 


1 .79** 


4 


L.O 


60.30 




79.09 


79.27 


79.C8 




78.95 


79. 32 


.54 


1.17** 




.9 


80.16 




79.06 


79.35 


79.90 




79.08 


79. 37 


.60 


.88** 




.9 


79.98 




79.04 


79.45 


79.91 




79.25 


79.-52 


.67 






.7 


79. ?6 




79.00 


79.58 


79.93 




79.47 


79.50 




* 




.6 


79 46 




, 8.96 


79.75 


79.95 




79.76 


79.59 


.90 


.50 * 


5 


1.0 


79.42 




78.72 


78.66 


77.74 




78.03 


77.45 


.59 


2.51** 




.9 


79.22 




78.72 


78.69 


77.74 




78 26 


77.44 


.65 


2.04** 




.8 


78.97 




78.73 


78.73 


77.73 




78.55 


77.41 


.7J 


1.71" 






78.65 




'8.74 


78.79 


77.73 




78.92 


77.38 


.8.4 


i.7l*« 




.6 


"'8.22 




78.76 


78.66 


77.73 




'9.41 


77.31 


.98 


2.42** 


6 


1.0 


■>8.18 




7 3.98 


76.30 


73.30 




72.87 


73.52 


.65 


21.43 




.9 


78.10 




73.92 


76.38 


73.36 




73.04 


73.37 


.72 


18.69 




.8 


77.76 




73.84 


76.48 


73.44 




73.25 


73.18 


.81 


16.13 




.7 


77.31 




73.7) 


76.61 


73.54 




73.53 


72.93 


.92 


13.22 




.6 


76.71 




73.60 


76.79 


73.67 




73.90 


72.60 


1.08 


10.47 


• 

A random staple 


rf.w selected 


free all noa-CE 


students to supply the data 


for 


these groups. 










ustcd group marts do 


not 


differ significantly aaong the six groups at 


.01 


level. 
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Table B3-19 



Mean Student Affect Scores and Wi thin-Group Regressions of Posttest t on Pretest Scores 
for Three Groups of CE Students and Two Comparison Groups of Needy Non-CE Students 



Grade 


• 


Title I 
Students 
in Title I 
Schools 


Other-CE 

Students Students 
in Title I In Other-CE 
Schools Schools 


Needy Non-CE 
Students in 
CE Schools 


Needy Non-CE 
Students in 
Non-CE 
Schools 


Grade 2 


H 


2,748 


Reading CE Status 
869 


651 


1,423 


578 


Fall (Pretest) 
Spring (Posttest) 
Hi thin-Group Slope* 


Mean 
Mean 


83.86 
85.78 
.41 


79.54 
84.17 
.44 


80.50 
81.82 
.40 


84.46 
85.44 
.39 


83.11 
86.00 
.35 


Grade 3 


N 


2,784 


t 

826 


593 


1,369 


547 


Fall (Pretest) 
Spring (Posttest) 
Wi thin-Group Slope* 


Mean 
Mean 


84.67 
84.36 
.48 


84.37 
v 83.73 
.47 


81.94 
81 . 85 
.40 


83.14 
83.44 
.47 


83.65 
82.29 
.45 


Grade 4 


N 


2,206 


828 


586 /: 


1,644 


566 


Fall (Pretest) 
Spring (Posttest) 
Within-Group Slope* 


Mean 
Mean 


80.54 
80.85 
.53 


80.36 
80.01 
.59 


78.37 
.53 


78.90 
79.60 
.52 


79.87 
81.43 
.55 


Grade 5 


K 


2,097 


753 


555 


1,785 


501 


Spring (Posttest) 
Within-Grcup Slope* 


Mean 
Mean 


81.26 
80.55 
. 56 


79.62 
77.96 
.58 


77.20 
78.16 
.50 


79.77 
79.01 
. 60 


82.06 
80.25 
.56 


Grade 6 




1,867 


847 


584 


2,022 


628 


Fall (Pretest) 
Spring (Posttest) 
Hi thin-Group Slope* 


Mean 
Mean 


79.99 
79.54 
.65 


77.42 
75.95 
.68 


74.96 
73.81 
.66 


73.89 
72.34 
.62 


76.95 
74.86 
.70 








Math CE status 








Grade 2 


N 


1,500 


725 


279 


1,233 


897 


Fall (Pretest) 
Spring (Posttest) 
Hi thin-Group Slope* 


Mean 
Mean 


85.99 
87.42 
.40 


80.90 
83.62 
.41 


8C.25 
84.45 
.42 


83.98 
86.08 
.38 


82.18 
85.01 
.33 


Grade 3 


N 


1,651 


679 


353 


1,289 


993 


Fall (Pretest) 
Spring (Posttest) 
Within-Group Slope* 


Mean 
Mean 


86.68 
86.58 
.48 


82.69 
83 . 29 
.47 


82.97 
8 1 . 07 
.47 


84.00 
83.62 
.48 


81.93 
82.36 
.43 


Grade 4 


N . 


1,324 


799 


353 


1,370 


1,095 


Fall (Pretest) 
Spring (Posttest) 
WitMn-Group Slope* 


Mean 
Mean 


81.63 
81.55 
.54 


79.65 
79 . 27 
.55 


77.96 
78. 54 
.51 


78.79 
79.83 
.57 


78.76 
79.69 
.54 r 


Grade 5 


N 


1,268 


704 


373 


1,481 


1,201 


Fall (Pretest) 
Spring (Posttest) 
Within-Group Slope* 


Mean 
Mean 


81.94 
81.21 
.56 


78.77 
78.66 
.53 


78.35 
78.35 
.54 


80.49 
79.55 
.61 


79.05 
77.88 
.57 


Grade 6 


N 


1,057 


807 


432 


1.677 


1,249 


Fall (Pretest) 
Spring (Posttest) 
Within-Group Slope* 


Mean 
Mean 


79.82 
80.89 
.67 


76.83 
74.56 
.67 


74.80 
75.56 
.65 


75.82 
74.47 
.-65 


75.18 
73.55 
.66 


'slopes do not differ significantly among 


the five groups at 


.01 level. 








Table B3-20 

ANCOVA of Student Affect Scores for the Three Groups of CE Students and Two Comparison Groups 
of Needy Non-CE Students with Unreliability Corrections for the Pretest Scores 



Grade 



Reliability 
Estimate 



Title I 
Students 
in Title I 
Schools 



Other -CE 
Students 
in Title I 
School s 



CE Students 
In Other-CE 
Schools 



Needy Non-CE 
Students in 
CE Schools 



Needy Non-CE 
Students m 
Non-CE 
Schools 



Corataon 
Regression 
Coefficient 









Adjusted Group Means 


- Reading CE Status 








2 


1.0 


85.43 


85. 56 


82.82 


84.85 


85.95 


.40 


3*1 




.9 


85.39 


85 71 


82.93 


84 . 78 * 


85.94 


.45 


3 .45 




.8 


85. 34 




S3. 07 


84 .7 0 


- 85.93 . 


.50 


3.34 




.7 


85.28 


86 15 


83.25 


84 . 59 


A '85.93 


.58 


3.34 




.6 


85.19 


86.48 


83.49 


84.45 


85.91 


.67 


3.60 


3 


1.0 


84.01 


83. 53 


82.78 


83 .81 


82.42 


.47 


1.52* » 




.9 


83.98 


83. 51 


82 


88 


83 .85 


82.44 


. 52 


1.38* 




.8 


83 . 93 


83.48 


83 


01 


83. 90 


82.46 


.58 


1.22* 




_ 7 


83 .87 


83. 44 


83 


18 


83 . 97 


82.48 


.66 


1.07* 




.6 


83 .79 


83. 39 


83 


40 




82.51 


.78 


.97* 


4 


1 .0 


80.43 


79.69 


79 


44 


80.07 


81.38 


.54 


1.44* 




.9 


80.39 


79.65 


79 


.52 


80. 12 


81.38 


.60 


1.34* 




.8 


80. 33 


79.61 


79 


.63 


80. 18 


81 . 37 


.67 


1.25* 






80. 26 


79.55 


79 


.76 


80. 26 


81. 36 


.77 


1.19* 




.6 


80.16 


79.48 


79 


94 


8C. 38 


81.35 


.89 


1.22* 


5 


1.0 


79 . 98 


78.32 


7<> 


.90 


79.29 


79. 21 


.57 


1.85* 




.9 


79.91 


78.36 


80 


.09 


79 . 32 


79.10 


.63 


1.78* 




.8 


79.83 


78.41 


80 


.33 


79136 


78.95 


.71 


1.81* 




.7 


79 73 


78.48 


80 


.64 


79.40 


78.77 


.81 


2.03* 




.6 


79 59 


78.56 


31 


.06 


79.47 


78. 52 


. 95 


2.66* 


6 


1.0 


77.42 


75.51 


74 


.97 


74.20 


74 .72 


.65 


10.99 




.9 


77.18 


75.46 


75 


.10 


74.41 


74.70 


.73 


8.29 




. 8 


76.88 


75.40 


75 


.26 


74.67 


74.68 


.82 


5 .50 




.7 


76.50 


75.32 


75 


.47 


75.00 


74.65 


.93 


2.89* 




.6 


76.00 


75.21 


75 


.75 


75.44 


74.62 


1.09 


1.08* 








Adjusted Group Means 


- Math CE Status 






1 


2 


1.0 


86.49 


84.65 


85. 


73 


85.92 


8S.S4 


.38 


1.52* 




.9 


86.39 


84.76 


85. 


87 


8S.91 


85 . 60 




1.17* 




.8 


86. 26 


84.90 


86. 


)5 


8S.88 


85.67 


.48 


.81* 




.7 


86. 10 


8S.09 


86. 


28 


8S.86 


85.77 


.55 


.49* 




.6 


85.88 


85.33 


86. 


38 


8S.82 


85.90 


.64 


.30* 


3 


1.0 


8S.43 


84.01 


82. 


65 


83.72 


83.43 


.47 


3.93 




■9 


85.31 


84.09 


82. 


72 


83.7 3 


83 . SS 


. 52 


3 .23* 




.8 


85. 15 


84.19 


82. 


80 


83.75 


83.70 


.58 


2.47* 




.7 


84.94 


84.32 


82. 


91 


83.77 


83.89 


67 


1.70* 




.6 


84. 67 


84.49 


83. 


05 


83.79 


84. IS 


'8 


1.02* 

* 


4 


1.0 


80.45 


79.26 


79. 


46 


80.29 


80.16 


.55 


.88* 




_ 9 


00. 33 


79.26 


79. 


56 


80.34 


80.21 


.61 


. -79* 




.8 


80.18 


79.26 


79 


68 


80.40 


80.28 


.68 


.76* 




.7 


79.98 


79.25 


79. 


85 


80.49 


80.36 


.78 


.84* 




.6 


79.72 


79.25 


80 


06 


80.59 


80.48 


.91 


1.18* 


5 


1.0 


80.17 


79.42 


79 


3b 


79.34 


78.48 


.57 


1.89* 




.9 


80.06 


79.50 


79. 


47 


79.31 


78.55 


.63 


1.53* 




.8 


79.91 


79.61 


79. 


61 


79.28 


78.63 


.71 


1.18* 




.7 


79.73 


79.74 


79. 


78 


79.24 


78.74 


.81 


.88* 




.6 


79.48 


79.93 


80 


02 


79.19 


78.88 


.95 


.78* 


6 


1.0 


78.73 


74.37 


76 


72 


74.95 


74.45 


.66 


15.10 




.9 


78.49 


74.35 


76 


85 


75.00 


74.55 


.74 


13.26 




.8 


78.19 


7^4.32 


77.01 


75.07 


74. b8 


.83 


11.23 




.7 


77.80 


74.29 


n 


21 


75.16 


74.84 


.95 


9.04 




.6 


77.28 


74.24 


ii 


49 


75.27 


75.05 


1.10 


6.86 



* Adjusted group means do not differ significantly among the five groups at -01 level 
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Table B3-21 ; 

Mean Student Af rec » Scores and Within -Group Regressions of Posttest on Pretest Scores 
For the CE Students and Two Comparison Groups of Needy Non-CE Students 



Grade 



CE Students 



Needy Non-CE 
students in 
CE Schools 



Needy Non-CE 
Students on 
Non-CE Schools 



Grade 2 


It 




Reading CE Status 
4,268 1,423 


578 


Fall (Pretest) 
Spring (Posttest) 
Within-Gro»*p Slope * 


Mean 
Kean 




82.46 
84.84 
.42 


84.46 
85.44 
.39 


83.11 
86.00 
.35 


Grade 3 


N 




4,203 


1,369 


547 


Fall (Pretest) 
Spring (Posttest) 
Within-Group Slope * 


Mean 
Mean 




84.22 
83.87 
.47 


83.14 
83.44 
.47 


83.65 
82.29 
.45 


Grade 4 


N 




3,620 


1,644 


566 


Fall (Pretest) 
Spring (Posttest) 
Within-Group Slope* 


Mean 
Mean 




80.14 
80.30 
.54 


78.90 
79.60 
.52 


79.87 
81.43 
.55 


Grade 5 ~N 


N 




3,405 


1,785 


501 


Fai) (Pretest) 
Spring (Posttest) . 
Within-Group Slope* 


Mean 
Mean 




80.23 
79.58 
.56 


79.77 
79.01 
.60 


82.06 
80.25 
.56 


Grade 6 


N 




3,298 


2,022 


628 


Fall (Pretest) 
Spring (Posttest) 
Within-Group Slope* 


Mean 
Mean 




78.43 
77.60 
.67 


73.89 
72.34 
*-62 


76.95 
74.86 
.70 








Math 


CE Status 




Grade 2 


N 




2,504 


1,233 


897 


Fall (Pretest) 
Spring (Posttest) 
Within-Group Slope* 


Mean 
Mean 




83.87 
85.98 » 
.41 


83.98 
86.08 
.38 


82.18 
,85.01 v 
.33 


Grade 3 


N 




2,683 


1,289 


993 


Fall (Pretest) 
Spring (Posttest) 
Within-Group Slope* 


Mean 
Mean 




85.18 
85.15 
.48 


84.00 
83.62 
.48 . 


81.93 
82.36 
.43 


Grade 4 


N 




2,476 


1,370 


1,095 


Fall (Pretest) 
Spr ing (Posttest) 

niuiiii uiuup siu^fc 


Mean 
Mean 




80.46 
80.38 
.54 


78.79 
79.83 
.57 


78.76 
79.69 
. 54 


Grade 5 


M 




2,347 


1,481 


1,201 


Fall (Pretest) 
Spring (Posttest) 
Within-Group Slope* 


Mean 
Mean 




80.41 
79.98 
.55 


80.49 
79.55 
.61 


79.05 
77.88 
.57 


Grade 6 


N 




2,296 


1,677 


1,249 


Fall (Pretest) 
Spring (Posttest) 
Within-Group Slope* 


Mean 
Mean 




77.82 
77.66 
.68 


75.82 
74.47 
.65 


75.18 
73.55 
.66 



ERIC 



*Slopes do not differ significantly among the three groups at .01 level. 



Table B3-22 

ANCCVA of Student Affect Scores for the CE Students and Two Comparison 
Groups of Needy Non-CE Students with Unreliability Corrections for the Pretest Scores 



Reliability 
Estimate 



CE Status 



CE Students 



Needy Non-CE 
Students in 
CE Schools 



Needy Non-CE 
Students in 
Non-CE Schools 



Common 
Regression 
Coefficient 



Adjusted Group Means - Reading CE Status 



1.0 


85.05 


84.84 


85. 


95 


.40 


.8b* 


.9 


85.07 


84.78 


85. 


94 


.45 


.92* 


.8 


85.10 


84.69 


85. 


93 


.51 


1.05* 


.7 


85.14 


84.59 


85. 


92 


.58 


1.27* 


. 6 


«* 85.19 


84.44 


85. 


91 


.67 


1.69* 


1.0 


83.74 


83.81 


82. 


42 


.47 


1.61* 


.9 


83.72 


83.85 


82. 


44 


. 52 




.8 


83.70 


83.90 


82. 


46 


.58 


1.59* 


_7 


83.68 


83.97 


82.48 


.66 


1.61* 


• D 


\83.65 


84.05 


82.51 


.78 


1.69* 


1.0 


80.10 


80.06 


81. 


38 


.54 


1.65* 




80.07 


80.12 


, 81. 


37 


.60 


1.62* 


Q 
• O 


80.05 


80.18 


81. 


37 


.67 


1.64* 


.7 


80.01 


80.26 


81. 


36 


.77 


1.71* 


.6 


79.96 


80.37 


81 


34 


.90 


1.91* 


1.0 


79.59 


79.29 


79 


•2* 


.57 


.31* 


~9 


79.59 


79.32 


79 


09 


.63 


.36* 


.8 


79.60 


79.35 


78 


95 


.71 


.46* 


.7 


79.60 


79.40 


78 


.77 


.82 


.67* 


.6 


79.60 


79.47 


78 


52 


.95 


1.09* 


1.0 


76.48 


74.21 


74 


.71 


.66 


14.19 


.9 


76.36 


74.41 


74 


.70 


.73 


10.64 


.8 


76.20 


74.67 


74 


.68 


.82 


7.00 


.7 


76.00 


75.01 


74 


.65 


. 04 


3.62* 


.6 


75.74 


75.45 


74 


.61 


1.09 


1.40* 




Adjusted Group Means - 


Math CE Status 








1.0 


85.87 


85.92 


85 


.54 


.39 


.15* 


.9 


85.86 


85.90 


85 


.60 


.43 


.10* 


.8 


85.84 


85.88 


85 


.68 


.48 


.04* 


.7 


85.82 


85.85 


85 


.77 


.55 


.01* 


.6 


85.79 


85.82 


85 


.90 • 


.64 


.01* 



1.0 
.9 
.8 
.7 
.6 



84.70 
84.65 
84.59 
84.51 
84.40 



83.72 
83.73 
83.75 
83.77 
83.79 



83.44 
83.56 
83.71 
83.90 
84.16 



.47 
.52 
.59 
.67 
.78 



2.87* 
2.31* 
1.70* 
1.10* 
.61* 



1.0 
.9 
.8 
.7 
.6 

'l.O 
.9 
.8 
.7 
.6 

1.0 
.9 
.8 
.7 
.6 



79.92 
79.87 
79.81 
79.72 
79.61 

79.81 
79.79 
79.77 
79.74 
79.70 

76.81 
76.72 
76.60 
76.45 
*»6.25 



80.29 
80.34 
80.40 
80.48 
80.59 

79.33 
79.31 
79.28 

79:23 

79.19 

74.95 
75.01 
75.07 
75.16 
75. 28 



80.16 
80.21 
80.28 
80.36 
80.48 

78.48 
78.55 
78.63 
78.74 
78.88 

74.45 
74.56 
74.68 
74.84 
75.06 



.55 
.61 
.69 
.78 
.91 

.57 
.63 
.71 
.81 
.95 

.67 
.74 
.83 
.95 
1.11 



.24* 
.41* 
.70* 
1.18* 
2.01* 

3.02* 
2.66* 
2.34* 
1.76* 
1.25* 

11.87 
10.01 
7.90 
5.56 
3.07* 



*Adjusted group means do not differ significantly among the three groups at .01 level. 
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Table B3-23 



Mean Student Affect scores and Within -Group Reg re n ions of Fosttest 
on Pretest Scores for the Three Groups of CE Students and a 
Comparison Group of Needy Non-CE Students 



Title I Other-CE CE Students Compari; 

Students in Students in in Other-CE Group 

Title I Schools Other-CE Schools Schools 



f Reading CE Status 

*9 



Grade 2 


N 






869 


651 


371 


rail (Pretest) 


Mean 


83.86 




79.54 


80.50 


85.65 


Spring (Posttest) 


Mean 


85.78 




84.17 


81.82 


87.70 


Within-Croup Slope** 




.41 




.44 


.40 


.33 


Grade 3 


N 


2, 784 




826 


593 


368 


Fall (Pretest) 


Mean 


84.67 




84.37 


81.94 


86.87 


Spring (Posttest) 


Mean 


84.36 




83.73 


81.85 


84.00 


Wi thin-Group Slope 




.48 




.47 


.40 


.47 


Grade 4 


N 


2 » 206 




828 


586 


338 


fall (Pretest) 


Mean 


80.54 




80.36 


78.37 


82.88 


Spring (Posttest) 


Mean 


80.85 




80.01 


78.69 


84.25 


Within-Group Slope 




.53 




.59 


.53 


.55 


Grade 5 


N 


2,097 




753 


555 


341 


rail (Pretest) 


Mean 


81.26 




79.62 


77.20 


87.56 


Spring (Posttest) 


Mean 


80.55 




77.96 


78.16 


84.53 


Within-Group Slope 




.56 




.58 


.50 


.53 


Grade 6 


N 


1,867 




847 


584 


333 


rail (Pretest) 


Mean 


79.S9 




77.42 


74.96 


81.89 


Spring (Posttest) 


Mean 


79.54 




75.95 


73.81 


79.82 


Within-Group Slope** 




.65 




.68 


.66 


.68 



Math CE Status 



Grade 2 


N 


1,500 


725 


279 


499 


rail (Pretest) 


Mean 


85.99 


80.90 


80.25 


85.30 


Spring (Posttest) 


Mean 


87.42 


83.62 


84.45 


87.38 


Within-Group Slope** 




.40 4 


.41 


.42 


.33 


Grade 3 


N 


1,651 


679 


353 


549 


rail (Pretest) . 


Mean 


86.68 


82.69 


82.97 


86.42 


Spring (Posttest) 


Mean 


86.58 


83.29 


82.07 


85.78 


Within-Group Slope •• 




.48 


.47 


.47 


.46 


Grade 4 


N 


1,324 


799 


353 


614 


rail (Pretest) 


Mean 


81.63 


79.65 


77.96 


81.67 


Spring (Posttest) 


Mean 


81.55 


79.27 


78.54 


82.65 


Within-Group Slope** 




.54 


.55 


.51 


.52 


Grade 5 


N 


1,268 


704 


375 


683 


rail (Pretest) 


Mean 


81.94 


78.77 


78.35 


83.08 


Spring (Posttest) 


Mean 


81.21 


78.66 


78.35 


ol.78 


Within-Group Slope** 




.56 


.53 


.54 


.53 


Grade 6 


N 


1.057 


807 


432 


601 


rail (Pretest) 


Mean 


79.82 


76.83 


74.80 


79.76 


Spring (Posttest) 


Mean 


80.89 


74.56 


75.56 


78.34 


Within-Group Slope** 




.67 


.67 


.65 


.65 



This comparison group comprises non-CE students who were judged to be in need of reading (math) 
CE and attended non-CE schools with high .concentrations of reading (math) low-achieving * 
students and free-meal participants. 



"slopes do not differ significantly among the groups at .01 level. 
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Table B3-24 

ANCOVA of Student Affect Scores for the Three Groups of CE Students and Two Comparison 
Soups of NeSdy Non-CE Students with Unreliability Corrections for Pretest Scores 



CE Status 



Reliability 
Estimate 



Title I 
Students in 
Title I Schools 



Other-CE 
Students in 
Other-CE Schools 



CE Students 
in Other-CE 
Schools " 



Comparison 
Groups* 



1.0 
.9 
.8 
.7 
,6 

1.0 
.9 
.8 
.7 
.6 

1.0 
.9 
.8 
.7 
.6 

1.0 
.9 
.8 
.7 
.6 

' 1.0 
.9 
.8 
.7 
.6 



1.0 
.9 
.8 
.7 
.6 

1.0 
.9 
.8 
.7 
.6 

1.0 
.9 
.8 
.7 
.6 

1.0 
.9 
.8 
.7 
.6 

1.0 
.9 
.8 
.7 
.6 



Adjusted Group Means - Reading CK Status 



79.84 
79.72 
79.57 
79.38 
79.13 



75.49 
75.59 
75.72 
75.88 
76.10 



77.84 
78.09 
78.40 
78.81 
79.35 



77.32 
77.21 
77.07 
76.09 
76/64 



Common 
Regression 
Coefficient 



bD. It 


85.47 


82.73 


86.50 


.41 


85.27 


85.62 


82.83 


86.37 


.45 


85.20 


85.80 


82.96 


86.20 


. 51 


85.12 


86.03 


83.12 


85.99 


. 58 


85.01 


86.34 


83.33 


85.70 


. 68 


OH . 


83 77 «. 


83 . 02 


82.87 


.47 


84.24 


83.77 


83.15 


82.74 


.52 


84.22 


83.77 


83.32 


82.58 


. 58 


84.20 


83.78 


83.52 


82.38 


. 67 


84.18 


83.79 


83.80 


82.11 


. 78 


80.76 


80.02 


79.78 


82. 89 


. 54 


80.75 


80.02 


79.90 


82.74 


.60 


80.74 


80.02 


80.05 


82.55 


.68 


80.73 


80.02 


80.25 


82.31 


. 77 


80.70 


80.03 


80.50 


81.99 


. 90 


80.35 


78.67 


80.21 


80.83 


. 56 


80.33 


78.75 


80.44 


80.42 


.62 


80.31 


78.85 


80.73 


79.91 


.69 


80.27 


78.98 


81.10 


79.25 


. 79 


80.22 


79.15 


81.58 


78.37 


.93 


78.72 


76.84 


76.33 


77.73 


.66 


78.63 


76.94 


76. 61 


77.50 


.74 


78.52 


77.06 


76.96 


77.21 


.81 


78.37 


77.22 


77.41 


76.84 


.95 


78.18 


77.43 


78 . 01-. 


76.35 


1.10 


Adjusted Group Means - 


Math CE Status 




.ft 


86.69 


84.88 


85.96 


86.92 


86.60 


85.02 


86.13 


86.87 


.43 


8C50 


85.19 


86.34 


86.80 


.49 


86.37 


85.42 


86.61 


86.72 


.56 


86.20 


85.72 


- 66.97 


86.61 


.65 


85.97 


84.57 


83.21 


85. 30 


. 47 


85.91 


84.71 


83.34 


65.25 


.52 


85.82 


84.89 


83.50 


85.18 


.59 


85.71 


85.12 


83.70 


85.10 


.67 


85.57 


85.41 


83.97 
f 


84.98 


i79 


81.06 


79.84 


80.02 


82.13 


.54 


81.00 


79.91 


80.19 


82.08 


.60 


80.93 


79.98 


80.39 


«2.01 


.67 


80.84 


80.09 


80.66 


81.91 


.77 


80.72 


80.22 


81.01 


31.79 


.90 


80.71 


» 79.87 


79.80 


80.66 


.54 


80.66 


80.01 


79.96 


80.54 


.60 


80.59 


80.18 


80.16 


80.38 


.68 


80.50 


80.39 


80.41 


80.18 


.77 


80.38 


30.68 


80.76 


79.92 


.90 



.66 
.74 
.83 
.95 
1.11 



5.14 
4.73 
4.32 
4.00 
3.91 

1.49** 
1.45** 
1.43** 
1.50** 
1.75** 

3.30** 
2.85** 
2.35** 
1.80** 
1.25** 

2.67** 
2.27** 
2.15** 
2.59** 
4.18 



5.29 v 

4.05 

2.84* 

1.89* 

1.63* 



2.20** 
1.72** 
1.23** 
.78** 
.49** 

3.45** 
2.87** 
2.23** 
1.60** 
1.05** 

2.66** 
2.28** 
1.88** 
1.47** 
1.11** 

.72** 
.40** 
.15** 
.06** 
.37** 

13.21 
12.08 
10.91 

9.82 

9.06 



*This comparison group comprises non-CE students who were judged to be in need of reading 
(math) CE and attended non-CE schools with high concentrations of reading (math) low- 
achieving students and free-meal participants. 
^Adjusted group means do not differ significantly among the groups at .01 level. 
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APPENDIX B4 

SUPPLEMENTARY TABLES FOR COMPARISONS 
OF GAINS CONDITIONAL ON PRETEST SCORES 
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Grade 



Table B4-1 

•Cut-Off Pretest Scores Used in the Comparisons. of Predicted 
• Posttest Scores Between CE and Non-CE Students* 



Approximate 
Percentile 



♦ Reading 
Achievement 



VSS (Raw S^ore) 



9 Math 
Achievement 
\ 

VSS (Raw Score) 



Practical 
Achievement 
Scale 

Raw Score 



30 


326 


(10) 


,314 


(12) 


35 


333 


(11) 


320 


(13) 


40 


339 


(12) 


326 


(14) 


45 


345 


(13) 


111 




30 


391 


(18) 


375 


(14) 


35 


396 


(19) 


382 


(15) 


40 


405 


(21) ' 


388 


(16) 


45 


412 


(23) 




\ J- ' ) 


30 


427 


(25) 


418 


(25) 


35 


436 


(27) 


427 


(27) 




444 


(29) 


435 , 


(29) 


45 


456 


(32) 


442 


(31) 


30 


462 


(26) 


460 


(23) 


35 


468 


(27) 


467 


(24) 


40 


478 * 


(29) 


480 


(26) 


45 


487 


(31) 


487 


(27) 


30 


496 


(33) 


511 


(31) 


35' 


508 


(36) 


522 


(33) 


40 


518 


(39) 


532 


(35) 


45 


527 


(42) 


542 


(37) 


30 


519 


(27) • 


536 


(21) 


35 


531 


(29) 


545 


(22) 


40 


541 


(31). 


554 


(23) 


45 


551 


(33) 


J 562 


(24) 



NA 



NA 



NA 



9 
10 
11 
12 

13 
15 
16 
17 

17 
18 
20 
21* 



*The 'cut-off 1 pretest scores are selected to be as close as possible to the 

scores for the 30th, 35th, 40th, and 45th percentiles according to the Fall 

norm. For reading and math, the at-level norms are used to select these 
cut-off scores for comparison. 
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Table B4-2 



A CE students and 
D Comparison Croups* 
S 



CE Students 
Nvtt-CE/CE 

1 *on-CZ/Non-CE 
Needy Non-CE/CE 

; Needy Non-CE/Non-CE 

CE Students 
NOft-CE/CE 

2 Non-CE/Non-CE 
Needy Non-CE/CE 
Needy Non-CE/Xon-CE 

CE Students 
Non-CE/CE 

3 Non-CE/Won-Cfr 
Needy Non-CE/CE 
Needy Non-CE/Non-CE 

CE Students 
Non-CE/CE 

4 Non-CE/Non-CE 

" Needy Non-CE/CE 
Needy Non-CE/Non-CE 

CE students 
Non-CE/CE 

5 Non-CE/Non-CE 
Needy Non-CE/CE 
Needy Non-CE/Non-CE 

CE Students 
Wbn-CE/CE 
5. Non-CE/Non-CE 
Needy Non-CE/CE 
Needy Non-CE/Non-CE 



4*346 

10,S52 
2,177 
1,999 
541 

4,688 
8,847 
1,976 
1,572 
* 678 

4,535 
8,881 
1,961 
1*473 
591 

3,875 
9,599 
* 1,980 
1,729 
613 

3,616 
10,391 
2,2*7 
1,899 
548 

3,507 
12,658 
2,553 
2,124 
676 



3ftth Percentile 'Cutoff 



Linear 



Quadratic 





t • • 

<Uff 


.yIx 


*diff 


36S 


4 

* * 


383 




396 


-15.52 


395 


-14.74 


395 


-9.82 


396 


-30.71 


380 


5.64 


379 


3.68 


377 


4.90 


380 


1.67 


o 

4 i i 




429 




440 


-11.76 


440 


-15.64 


438 


-4.93 


4J5 


-5.66 


428 


4.43 « 


425 


3.41 


424 


6.21 


421 


4.91 


460 




458 




467 


-10.24 


467 


-12.98 


465 


-5.33 


465 


-6.72 


460 


0.17 


458 


-0.36 


453 


5.25 


454 


2.27 


4 89 




483 




497 • 


-11.32 


497 


-17.90 


497 


-6.93 


495 


-9.99 


469 


-0.04 


485 


-1.13 


469 


0.15 


484 


-0.20 


518 




514 




526 - 


11.60 


526 


-15.71 


526 


-8.02 


524 


-9.68 


518 


0.51 


514 


-0.01 


513 


2.71 


511 


1.61 


541 • 




537 




548 


-9 19 


546 


-14.52 


546 


-5.35 


546 


-8.33 


541 


0.23 


539 


-1.59 


540 


1.03 


535 


0.91 



35th Percentile 'Cutoff 



Linear 



391 

402 -17.00 
401,-10.46 
364 6.74 
382 5.44 

437* 

445 -12.72 
442 -5.33 
432 4.45 
427 6.51 

467 

475 -11.99 
473 -6.4* 
467 0.27 
458 5.74 

494 

502 -12.10 

502 -7.56 

494 0.23 

494 0.05 

526 

537 -12.76 
537 -8.90 
527 0.75 
523 2.54 

552 

559 -10.41 
556 -6.44 
551 0.71 
550 1.11 



Quadratic 



r|x *diff y|x *dlff 



389 
401 
402 
384 
384 

433 
445 

439 
429 
425 



-15.26 
-11.02 
4.65 
2.36 



-16.55 
-5.74 
'3.35 
5.18 



465 

475 -14.28 

472 -7.31 

465 -0.46 

459 3.02 

466 

502 -18.10 
500 -10.02 
489 -1.08 
489 -0.25 

525 

537 -15.59 

535 -9.35 

525 0.10 

522 1.36 

546 

559 -14.86 
557 -8.44 
549 -0.65 
546 '0.79 . 



40th Percentile 'Cutoff 1 



Quadratic 



y|x fc diff $|x Sjiff 



396 
407 
406 
388 
365 

443 
452 
449 
438 
432 

473 
482 • 
460 
473 
463 

502 
511 • 
511 
501 
502 



-17.70 
■10.69 
7.35 
5.69 



-14.13 
-5.91 
4.34 
6.82 



-13.31 
-7.39 
0.34 
5.96 



-13.10 
-6.46 
0.63 
-0.09 



537 , 

547 -13.34 

546 -9.39 

536 0.91 

531 2.38 

560 

566 -10.96 

567 -7.18 
559 1.04 
556 1.14 



534 

546 -14.83 
544 -8.76 
534 0.15 
532 1.12 

557 

568 -14.55 
566 -8.22 
J557 -0.16 
556 0.65 



45th Percentile 'Cutoff* 



Llneer 



544 

555 -13.62 

555 -9.65 

543 1.01 

539 2.26 

569 

577 -11.29 

576 -7.75 

567 1.30 

566 1.16 



Quadretlc 



y|x fc diff y|x Siiff 



394 




400 


-17.82 


399 




406 


-15.57 


413 


412 


'-15.76 


407 


-11.09 


411 


-10.5-? 


412 


-10.99 


387 


5 ■ 68 


392 


7.66 


391 


6.43 


388 


3.15 


* 389 


5.79 


391 


4.00 


440 




449 




446 




452 


-17.27 


456 


-14.87 


458 


-17.31 


446 


-5.70 


454 


-6.23 


452 


-5.*4 


436 


3.16 


443 


4.16 


442 


2.94 


431 


5.50 


436 


6.91 


436 


5.58 


471 




462 




481 




481 


-15.08 


492 


-14.70 


492 


-15.62 


479 


-7.66 


490 


-8.51 


,489 


-7.92 


471 


pO.54 


462 


0.42 


481 


-0.66 


464 


3.75 


471 


6.06 


471 


4.63 


497 




509 




505 




510 


-17.83 


519 


-13.65 


518 


-16.94 


508 


-9.79 


519 


-9.08 


516 


-9.29 


498 


-0.99 


506 


0.92 


506 


-0.91 


497 


-0.31 


509 


-0.19 


505 


-0.35 



543 

554 -13.64 
553 -7.99 
543 0.16 
541 0.91 



567 
578 
575 
566 
566 



•13.64 
-7,72 
0.56 
U.47 
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Table B4-3 



Comparisons of Predicted Math Posttest Scores Between CE Students and Each of Four Comparison Croups of Non-CE Students 
at Pour 'Cutoff Pretest Scores that Correspond to the 30th, 35th, 40th, and 45th Percentile Ranks of the National Norms 
(Linear and Quadratic Within-Croup Regression Kodcls of Posttest Score on Protest Score Are Employed for the Prediction)^ 



CE Students and 
Comparison Groups* 



CE Students 2,782 

Non-CE/CE 8,951 

1 Non-CE/Non-CE 5,105 

Needy Non-CE/CE % 1,599 

Needy Non-CE/Non-CE 1,051 

CE Students 2,785 

Non-CE/CE 7,966 

'2 Non-CE/Non-CE 4,727 

Needy Non-CE/CE 1,353 

Needy Non-CE/Non-C2 1,035 

CE Students 2,930 

Non-CE/CE 7,799 

3 Non-CE/Non-CE 4,633 
Needy Non-CE/CE 1,370 
Needy Non-CE/Non-CE 1,057 

CE Students 2,652 

Non-CE/CE 7,954 

4 Non-CE/Non-CE 4,810 
Needy Non-CE/CE 1,455 
Needy Non-CE/Non-CE ^ l » lf>9 

CE Students 2,499 

Non-CE/CE 8,330 

5 Non-CE/Non-CE 5,389 
Needy Non-CE/CE 1,606 
Needy Non-CE/Non-CE 1,270 

CE Students 2,449 

Non-CE/CE 10,410 

6 Non-CE/Non-CE 5,819 
Needy Non-CE/CE 1»767 
Needy Non-CE/Non-CE 1,321 



30th Percentile 'Cutoff 



Linear 



Quadratic 



y|x* Siiff'* Ylx^diff 



175 
380 
377 
364 
360 

428 
437 ■ 
432 
421 
417 

470 
462 • 
462 • 
464 
463 

507 
516 • 
516 
506 
504 

55C 
560 
558 
545 
542 

577 
580 
581 
570 
567 



-6.79 
-2.64 
9.23 
11.40 



•10.88 
-4.65 
4.92 
7.46 



•12.47 
•11.61 
4.62 
4.96 



■11.14 
-7.86 
1 23 
2.14 



-9.42 
-6.60 
3.69 
5.40 



-3.43 
-3.43 
4.76 
6.13 



373 
380 
376 
362 
359 

424 
436 
432 
419 
417 



-7.81 
-3.31 
7.64 
9.37 



12.24 
-6.60 
3.82 
4.67 



471 

483 -11.81 
-10.72 
3.90 
2.77 



463 
465 
466 



507 
513 
516 
504 
504 

547 
559 
555 
542 
541 

573 
580 
S80 
567 
565 



10.97 
-7.60 
1.29 
1.42 



-9.86 
-6.27 
3.16 
3.16 



-5.77 
-5.50 
3.74 
4.45 



35th Percentile 'Cutoff 



Linear 



Quadratic 



y|x *diff y|x *diff 



379 
385 
382 
368 
364 

433 
443 
438 
426 
422 



-7.60 
-3.34 
9.42 
11.77 



•11.25 
-5.04 
4.97 
7.46 



477 

489 -13.18 
-12.92 
4.82 
5.48 



490 
470 
468 



5i3 

524 -11.52 
8.47 
1.42 
2.16 



522 
511 
509 



377 
385 
381 
366 
3-52 

430 
442 
437 
424 
421 

478 
4Q1 
491 
471 
471 

512 
525 
522 
510 
509 



-8.28 
-3.69 
7.78 
9.60 



•12.33 
-6.76 
3.61 
4.97 



12.83 
11.92 
4.15 
3.72 



11.43 
-6.04 
1.39 
1.50 



559 

570 -10.35 

568 -7.45 

553 4.05 

550 5.11 

564 

588 -4.19 

589 -4.37 
577 5.09 
574 6.19 



556 

569 -10.37 
-6.56 
3.06 
3.31 



565 
551 
550 



580 
566 
589 
574 
572 



-6.26 
-6.16 
3.99 
4.56 



40th Percentile 'Cutoff 
Linear Quadratic 



y|x t diff y|x *diff 



364 

390 -6.21 

387 -3.96 

372 9.34 

367 11.81 

436 

447 -11.36^ 
442 -5.10 
430 4.94 
426 7.33 

463 

495 -13.46 
497 -13.75 
476 4.70 
473 5.75 

523 

535 -11.83 
533 -9.30 
521 1.67 
519 2.17 

567 

579 -10.91 
577 -8.01 
560 4.10 
558 4.79 



382 
389 
386 
371 
366 

435 
447 
442 
429 
425 

483 
498 
496 
476 
475 



-6.62 
-4.02 
7.79 
10.10 



12.25 
-6.61 
3.75 
5,24 



13.52 
12.83 
4.34 
4.60 



522 

536 -12.00 
-8.72 
1.50 
1.66 



533 
520 
519 



591 
597 
597 
584 
581 



-4.88 
-5.25 
5.30 
6.12 



565 

578 -10.67 
574 -6.79 

560 2.83 
556 3.40 

566 

596 -6.67 

597 -6.75 

561 4.20 

579 4.68 



45th Percentile 'Cutoff 
Linear Quadratic 



Y|X t diff Y|X *diff 



388 
394 
391 
375 
370 

442 
452 
447 
435 
43C 



-8.53 
-4.38 
9.14 
11.66 



•11.26 
-5.08 
4.85 
7.14 



488 

501 -13.44 
14.18 
4.55 
5.87 



503 
461 
477 



529 
541 
539 
526 
525 



11.77 
-9.56 
1.76 
2.13 



575 

568 -11.22 
585 -8.38 
567 4.09 
566 4.46 



598 
604 
605 
590 
587 



-5.41 
-5.94 
5.39 
5.99 



385 

394 -8.81 

390 -4.26 

374 7.64 

369 10.21 

440 

452 -12.02 
446 -6.34 
434 3.64 
429 5.50 

469 

504 -13.94 
504 -13.51 
481 4*.45 
478 5.34 

528 

542 -12.15 
539 -9.00 
525 1.50 
525 1.73 

573 

587 -10.75 
563 -6.69 

569 2^ 
566 3.42" 

595 
603 
604 
588 
586 



• The predicted posttest scores <y|x> are obtained from the estimated within-group regressions of posttest scores <Y> on pretest scores (X) . The 
four comparison groups of non-CE students are: Non-CE/CE - math non-CE students in schools that provide CE in math; Non-CE/Non-CE - math 
non-CE students in school u that do not provide CE in math; Needy Non-CE/CE - a subgroup of Non-CE/CE judged to be in need of math CE; 
Needy Non-CE/Non-CE » a subgroup of Non-CE/Non-CE judged to be in need of math CE. 

O itical value at the .01 level for the two- tailed t-tests of the differences in predicted posttest scores between CE students and the 
CD I p. lion group is 2.58, as the d.f. exceeds 500 in all cases. Negative t-values indicate that the predicted score for the CE students is 
^£\L^ than that for the comparison group. ^ Q ^ 



/ 



Table B4-4 



Comparisons of Predicted Practical Achievement Posttest Scores Between CE Students and Each of Four Comparison Groups of Non-CE Students 
at Four •Cutoff Pretest Scores that Correspond to the 30th, 35th, 40th, and 45th Percentile Ranks of the National Norms 
(Linear and Quadratic Within-Group Regression Models of Posttest Score on Pretest Score Are Employed foi the Prediction)* 



G 
R 

A CE Students and 
n Comparison Groups* 
E 



CE Students 4,336 

Non-CE/CE* 9,097 

Non-CE/Non-CE 1,912 

Needy Non-CE/CE 1,784 

Needy Non-CE/Non-CE 634 

CE Students 4,087 

Non-CE/CE 9,830 

Non-CE/Non-CE 2 ,173 

Needy Non-CE/CE 1,953 

Needy Non-CE/Non-CE 617 

CE Students 3,913 

Non-CE/CE 12,156 

6 Non-CE/Non-CE 2 , 493 

Needy Non-CE/CE 2,328 

Needy Non-CE/Non-CE *704 



30th Percentile 'Cutoff 



Quadratic 



Y|X* fc diff** i|x Siiff 



13.1 
15.0 
14.6 
13.4 
13.3 

16.3 
17.9 
17.8 
16.6 
16.1 

19.6 
20.9 
20.3 
20.0 
19.7 



-20.15 
-10.58 
-2.65 
-1.20 



-16.98 
-10.09 
-2.24 
0.86 



-15.77 
-5.43 
-3.02 
-0.43 



12.9 
15.0 
14.6 
13.3 
12.9 

16.2 
18.0 
17.6 
16.5 
16.1 

19.5 
20.9 
20.5 
20.1 
19.7 



■20.57 
-11.43 
-2.58 
-0.27 



■16.32 
-8.12 
-1.70 
0.37 



■14.45 
-6.46 
-3.77 
-1.06 



35th Percentile •Cutoff 



Li near 



Quadratic 



Y|X *diff 1 Y |x *di 



ff 



13.8 

15.7 -20.67 
15.4 -11.15 
14.2 -2.59 
13.9 -0.65 



13.6 

15.8 -21.32 



17.8 
19.3 
19.1 
18.1 
17.6 

20.4 
21.6 
21.0 
20.7 
20.5 



•10.75 
-9.92 
-1.88 
0.89 



-14.77 
-5.40 
-2.53 
-0.48 



15.4 
14.0 
13.5 

17.7 
19.4 
18.9 
17.9 
17.6 

20.2 
21.5 
21.2 
20.7 
20.5 



-11.69 , 
-2.43 
0.3? 



-15.99 
-6.80 
-1.44 
0.41 



•13.68 
-6.37 
-3.34 
-1.06 



40th Percentile 'Cutoff 



Linear 



Quadratic 



i|x *diff i|x *diff 



14.6 

16.5 -20.64 
16.1 -11.51 
14.9 -2.41 

14.6 -0.09 

18.5 

20.0 -16.07 
19.8 -9.53 
18.8 -1.64 

18.3 0.86 

21.8 

22.8 -12.03 

22.4 -5.00 
22.0 -1.51 

21.9 -0.55 



14.3 
16.6 
16.2 
14.7 
14.1 

18.4 
20.1 
19.5 
18.7 
18.3 

21.7 
•>2.8 
22.6 
22.0 
21.9 



■21.33 
•11.57 
-2.26 
0.81 



•15.62 
-6.23 
-1.34 
0.45 



■11.62 
-5.87 
-2.16 
-0.88 



45th Percentile 'Cutoff* 



Quadratic 



i|x *diff y|x *diff 



15.3 
17.2 
16.9 
15.7 
15.3 

19.3 
20.7 
20.5 
19.5 
19.1 

22.5 
23.5 
23.1 
22.7 
22.6 



•20.02 
•11.61 
-2.16 
0.41 



•15.08 
-8.94 
-1.39 
0.83 



■10.51 
-4.66 
-1.06 
-0.56 



15.1 
17.4 
16.9 
15.4 
14.8 



•20.89 
•11.24 
-2.11 
1.17 



19.2 

20.9 -15.14 



20.2 
19.4 
19.0 

22.5 
23.5 
23.3 
22 7 
22.6 



-5.74 
-1.25 
0.50 



-10.18 
-5.38 
-1.40 
-0.70 



The 



* The predicted posttest scores (y|X) are obtained from the estimated withm-group regressions of posttest scores (Y) on pretest scores (X). x« c 
four comparison groups of non-CE students are; Non-CE/CE - reading and math non-CE students in schools that provide CE in reading and/or math; 
Non-CE/Non-CE - reading and math Non-CE students in schools that do not provide CE in reading and math; Needy Non-CE/CE = a subqroup of Non-CE/CE 
judged to be m need of reading and/or nath CE; Needy Non-CE/Non-CE - a subgroups of Non-CE/Non-CE judged to be in need of reading and/or 
math CE. 

** The critical ue at the .01 level for the two-tailed t-tests of the differences in predicted posttest scures between CE students and the 
comparison gr t is 2.58 as the d.f. exceeds 500 in all cases. Negative t-values indicate that the predicted score for the CE students is 
lower than that for the comparison group. 
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Analysis for Reading and Math Achievement 

This last approach for the evaluation of the effectiveness of CE employs sta- 
tistical models to approximate the expected performance of CE students under 
the 'no-CE' situation. * In essence, we consider the pretest score and student 
background characteristics as predictors in the estimation of the posttest per- 
formance for a hypothetical group of non-CE students whose background and pre- 
test achievement level are comparable to those of the sample of CE students 
involved in the evaluation.: The predicted mean posttest performance for this 
hypothetical group of non-CE students is then used as the expected mean perfor- 
mance foj. the CE students in order to judge the effectiveness of CE. If we 
are reasonably certain that the actual mean performance for the CE students 
exceeds this comparison standard, it may be concluded that CE is effective. 
Conversely, if there is little chance for the observed mean performance of the 
CE students to exceed the standard, CE is judged to be ineffective. Following 
a similar position taken in the norm-referenced analyses, we adopt a probabi- 
lity level of .9 to express certainty. 

Regression Models for Estimating Expected Posttest Achievement. Two regres- 
sion models were developed for the estimation of the expected posttest perfor- 
mance assuming no CE intervention: one obtained with data for non-CE students 
in CE schools, and one with data for non-CE students in non-CE schools. As 
mentioned in the general discussion in the text, we separated these two groups 
of students in the development of the prediction models because the CE and 
non-CE schools may differ in school characteristics, characteristics of regular 
educational programs, as well as characteristics of student composition; and 
because there may be spillover effects of CE in the CE schools.^ A 15 percent 
random sample was selected from each of these two groups of non-CE students in 
each grade to provide the data for the estimation of the regression equations. 

The primary potential predictors included the pretest score, five student 
characteristics, and level of school's regular per-pupil expenditures. The 
five student characteristics employed were: white/minority status, participa- 
tion in free-meal programs (as a proxy for family economic status), mother's 
educational attainment, receipt of CE in the previous year (1975-76), and 
teachers judgment of need for CE. These characteristics were considered be- 
cause they are likely to have influences on achievement growth, particularly 
through their relationships with the educational climate at home, and possible 
learning problems. The regular per-pupil expenditures were divided into ten 
levels corresponding to ten intervals of equal frequencies in the distribution 
over the first-year representative sample. The pretest score and teacher's 
judgment of need for CE were obtained for reading and math separately. 

In addition, the squared pretest score was included in the pool of potential 
predictors because measurement errors of pretest scores may introduce non- 
lineanty to the regression model (Cochran, 1970). Considerations of possible 
differences in regression coefficients for the pretest score between groups of 
students with different characteristics led us to add also the products of the 
pretest score and the variable of each student characteristic to the predictor 
set. These product terms in effect represent the interactions between pretest 
achievement and student characteristics. When within-group regressions were 
different among groups of students with different characteristics, the appro- 
priate interaction terms would be selected into the regression model. On the 
other hand, if homogeneity of regressions held, the interaction terms would be 
ignored in the prediction model. In total, 13 variables were involved as 
potential predictors. 
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A best subset of the 13 variables, was obtained using the method of 'all pos- 
sible subset regressions' (Hocking, 1976), and employed in the estimation of 
the prediction model for the present analyses. The primary criterion for the 
subset selection was Mallow's Cp. For each analysis, five best subsets of 
predictors were selected according to this criterion. Then the coefficient 
of determination (R 2 ) , adjusted R 2 , and the regression coefficients for each 
subset were examined in order to choose a satisfactory subset for the final 
prediction model. The regression models for prediction were developed for 
reading and math separately, and for each of the two subsamples of non-CE 
students in each grade. The potential predictors for the models are listed 
in Table B5-1, along with indications of whether they were selected into the 
prediction models. 

To assess the validity of each prediction model, a second 15 percent random 
sample was independently selected from each group of non-CE students in each 
grade to serve as the cross-validation sample. Summary results of the cross- 
validation studies are presented in Table B5-2. On the basis of the summary 
statistics and the F-tests, and considering the large sample sizes, we judge 
the models to be quite adequate in most cases. Further information about the 
adequacy of the models is provided in Table B5-3, where possible biases of the 
prediction models against specific groups of students were examined. The data 
show that the models are generally" appropriate for predicting the posttest per 
formance of subgroups of students with different characteristics , as there is 
little evidence of biases. The reader is advised to study these data care- 
fully, as the same models are also employed to compute residual gain scores 
that serve as measures of growth in the analyses of Chapters 4 and 5. 

For convenience, we designate the prediction model developed from the data 
for non-CE students in non-CE schools as Regression Mode] A, and that from 
the data for non-CE students in CE schools as Regression Model B. The resi- 
dual gain scores computed with these models are accordingly named Residual 
Gain Score A and Residual Gain Score B in later chapters. 

Additional data that attest to the success of these models may be seen in 
Tables E-l and E-2 of Appendix E. There it is shown that the models give 
very accurate predictions of the actual mean performances for the two special 
subgroups of non-CE students who are judged as needing CE. These two groups 
of 'needy' non-CE students comprise the principal comparison groups in many 
of our analyses. The implication of these results is hat models developed 
from a random sample of non~CE students in general are not biased against 
groups of students whose pretest scores tend to be in the lower end of the 
distribution and who tend to have characteristics associated with edu< jitional 
deprivation . 
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Table B5-1 



Predictor Variables avloyed (/ in Table Entries) in the Regression Equations 
for Estimating the Expected Posttest Scores of the CE Students 



S 
i 



Potential Predictor Variables- 



Is 

w 
o 



I 

c 
o 

2 



a « 

§2 
•So 

-3 w 

w w 
w V 
' o 

2 



Pretest Score 

Caucasian-White/Minority (WM) 
Free-Meal Participation (FMP) 
CE Receipt. in 75-76 (CE75) 
Judged Need in CE (NEED) 
Mother's Highest Education (MOED) 
Regular Per-Pupil Expenditure (EXP) 
Pretest Score Squared 
Interaction - WM x Pretest 
Interaction - FMP x Pretest 
Interaction - CE75 x Pretest 
Interaction - NEED x Pretest 
Interaction - MOED x Pretest 



Pretest Score 

Caucasian-White/Minority (WM) 
Free-Meal Participation (FMP) 

CE Receipt in 75-76 (CE75) 
Judged Need in CE (NEED) 
Mother's Highest Education (MOED) 
Regular Per-Pupil Expenditure (EXP) 
Pretest Score Squared 
Interaction - WM x Pretest 
Interaction - FMP x Pretest 
Interaction - CE75 x Pretest 
Interaction - NEED x Pretest 
Interaction - MOED x Pretest* 



T 



T 



Variables Included in the Estimated Regression Equation for 



READING 


MATH 


PAS 






Grade 










Grade 








Grade 




1 


2 


3 


4 


5 


6 


1 


2 


3 


4 


5 


6 


4 


5 


6 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 




/ 


/ 


>' 


/ 


/ 






/ 


/ 


/ 




/ 


j 

V 


/ 






/ 












/ 




/ 




J 




✓ 






/ 








j 








J 
Y 






J 

Y 


/ 


/ 


/ 


/ 


/ 




/ 


j 

V 


/ 




J 


J 
V 


J 


J 

Y 


J 
Y 








/ 


/ 




/ 


/ 


/ 


/ 


J 






J 
Y 


J 
Y 






/ 












/ 




J 














/ 


/ 






/ 




/ 


/ 






























/ 






J 
Y 
















/ 






/ 




J 
V 












/ 












/ 














J 
Y 








/ 


/ 














/ 


J 
Y 






/ 






/ 




/ 


/ 














J 


J 
Y 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 








/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 








/ 


/ 


/ 




/ 




/ 


/ 






/ 










/ 








/ 








/ 




/ 


/ 


/ 


/ 


/ 


/ 




/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 




/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 


/ 












/ 


/ 










✓ 












/ 


/ 


/ 






/ 






/ 






/ 




/ 


















/ 




/ 
Y 




/ 


/ 










/ 








/ 






































/ 




/ 


/ 


/ 




/ 


/ 




/ 


/ 








/ 




/ 












/ 










/ 


/ 




/ 




/ 



Coding for the categorical variables: WM = 1 for White, 0 for Minority; FMP = 1 for participant, 0 for non-participant; 
CE75 = 1 for receipt, 0 for non-receipt; NEED = 1 for need in CE, 0 for no need in CE; MOED = 1 for at least high school, 
0 for less than high school; EXP = 1 to 10/ representing intervals of approximately equal frequencies. 
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Table B5-2 



Estimating and Cross- Val idating the Regression Equation of Achievement 
Posttest Score on Pretest Score and Selected Student-Level Variables* 



Grad« 


CE Availability 
"^in the School 


NP** 


Sample for 


Estimation 






Sample 


for 


Cross- Validation 






N 


RSQ** 


HSR** 


It 


RSQ** 


MSR** 


ASD** 


r** 


F** 




\ 








Reac 


ing 
















Not Available 


7 


755 


.48 


1104 . 30 


71 Q 

'13 


. 50 


1066 


.61 


1087 .95 


69 


2 . 80 


1 


Available 


6 


1,160 


.44 


1073.91 


1 ,107 


.42 


1194 


.25 


1202 .13 


64 


2.04 




Not Available 


4 


577 


.67 


841 . 13 


610 


.66 


922.39 


960 . 40 


80 




2 


Available 


5 


914 


.65 


854.63 


978 


.68 


786 


.72 


791 .95 


82 


2.08 




Not Available 


5 


624 


.73 


825 ■ 73 


649 




952 


.27 


952 .07 


85 


.98 


3 


Available 


6 


1,000 


.71 


850.13 


981 


.67 


881 


.06 


894.57 


.81 


3.15 




Sot Available 


5 


657 


.75 


1070.38 


644 


. 76 


892 


.07 


890.46 


.87 


.81 


4 


Available 


8 


1,018 


.75 


901 . 74 


1,072 


.73 


918 


.20 


* 935.69 


.85 


3.27 




Not Available 


9 


742 


.79 


939.93 


730 


.80 


1092 


.23 


1154.39 


.89 


5.15 


5 


Available 


7 


1,161 


.80 


852.67 


1,124 


.79 


881 


.48 


883.63 


.89 


1.34 


6 


Not Available 


4 


809 


.84 


871.94 


801 


.83 


923 


.79 


943.28 


.91 


4.38 




Available 


8 


1,471 


.81 


942.59 


1,310 


.79 


906 


.15 


927.10 


.89 


4.37 












Math 
















Not Available 


■7 


1 ,686 


.48 


1000.44 


1 ,806 


50 


1013 


.38 


1014 . 72 


. 70 


1 .30 


1 


Available 


6 


955 


.46 


1028.25 


1,035 


.48 


1122 


.69 


1141.67 


.68 


3.50 




N^c Available 


6 


1 ,569 


. 57 


1008.91 


1,572 


. 51 


1225 


.28 




. 71 


3 .60 


2 


Available 


5 


861 


.53 


1074.64 


811 


.52 


1284 


.00 


1307.44 


.71 


3.47 




Not Available 


7 


1,559 


.57 


1411.92 


1,581 


. 58 


1449 


.94 


1452 .08 




1 . 29 


3 


Available 


8 


875 


.52 


1317.28 


834 


.51 


1361 


.42 


1362.72 


.71 


1.09 




Not Available 


5 


1,659 


.62 


1541.11 


1,639 


.60 


1687 


.14 


1686.05 


. 78 


.85 


4 


Available 


5 


821 


.58 


1460.49 


848 


.58 


1556 


.58 


1563.23 


.76 


1.60 






7 


1.943 


.66 


1756.50 


1,875 


.62 


2009 


.25 


2063 .66 


.78 


7.35 


' 5 


Available 


7 


858 


.61 


2146.27 


916 


.61 


1953 


.85 


2008.12 


.77 


4.18 




Not Available 


8 


1,896 


.69 


2009.58 


1,931 


.67 


2118 


.54 


1164.73 


.82 


5.68 


6 


Available 


6 


1,088 


.68 


1805.65 


1,112 


.62 


2109 


.76 


2129.32 


.78 


2.47 












Practical Achievement 
















Not Aval lable 


7 


640 


.59 


16.46 


625 


.60 


17 


.06 


17.46 


76 


2.83 


4 


Available 


6 


1,027 


.59 


16.55 


1,034 


.'S3 


18 


.91 


18.91 


73 


.99 




Not Available 


7 


729 


.55 


17.52 


707 


.56 


17 


.43 


17.47 


74 


« .22 


5 


Available 


5 


1,124 


.53 


15.85 


1,051 


.56 


14 


.70 


14.82 


74 


2.34 




Not Available 


9 


778 


.67 


10.35 


768 


.56 


15 


.00 


15.31 


74 


2.57 


6 


Available 


7 


1,281 


.51 


12.97 


1,326 


.46 


12 


.46 


12.69 


67 


4.09 



Two random samples of non-CE students were drawn from schools where CE is not available in the subject area, 
one ferved as the estimation sample and the other served as the cross-validation sample. Similarly, two random 
samples of non-CE students were drawn from schools where CE is available in the subject area and used for the 
estimation and cross-validation of the regression model. For a list of the student-level variables involved in 
each case, please refer to Table B5-1. 

**NP « number of predictors in the equation, RSQ = squared nultiplc correlation. MSR = ncan squared residuals. 
ASD ■ average squared difference* between the observed posttest score (yl and the predicted score (y p ) based 
on the regression equation obtained in the estimation sample, r = correlation between > and yp, F = test of j 
goodness of fit of the regression equation obtained from the estimation sample when applied to the cross-validation j 
sasple. 

* j 
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i 
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. Table BS-3 



Average Differences Between Observed and Predicted Scores for the Cross-validation Sample by Student 
Characteristics* on the Basis of the Regression Equation Obtained from the Estimation Sample 



G 
R 
A 

E 


Availability 
of CE in 
the School 


Race/Ethnicity 




Free 


Meal 


Mother *s 


Educat ion 


Teacher Judgment 


White/ 
Caucasian 


Minor i ty 


Participant 


Non- 
Participant 


Less Than 
High School 


High School 
or More 


Need 
for CE 


No Need 
for CE 












Reading 












Not Available 


1.16* 


-5. 38* 


1.77 


-2.36 


- . 47 


-1.41 


1 . 04 


t-1.88 


1 


Aval laoie 




3.61 


3.90 


-1.19 


-2.55 


. 86 


-2 .40 


.67 1 




Not Available 


1.90 


1.10 


.50 


2.10 


-8.09* 


3 . 55* 


-5 . 73* 


4 .66* 


2 


|||« i 1 K W1 _ 

Ava i laJDi e 


-.66 


-3.91 


-5 


22* 


-.05* 


-1 1 . 00* 


.62* 


-1.56 


-1.31 




Not Available 






-5 


23* 


2.16* 


-1.80 


. 32 


-2 .69 


.72 ' 


3 


Aval lab le 


-2.01 


.87 


-1.05 


-1.52 


-2.52 


-1.16 


3.99 


-2.10 




^Not Available 


1.75 * 


- 1 . 64 


1 


,40 


.58 


2.92 


. 33 


1 . 47 


. 58 


4 


Available 


-2.15 


.65 


-2 


.55 


-1.19 


3.93* 


-2.98* 


5.06* 


-2.85* 




Not Available 


.23 


-3 . 28 


1 * 3 


.49 


.20 


1 . 59 


-1 . 38 


1. 19 


-1.31 


5 


Ava liable 


1.56 


.97 




.84 


2.33 


3.89 


.70 


2.36 


1.24 




Not Available 


-1 .03 


-5 . 70 


-7 


.40* 


-.66* 


-2.25 


-2.53 


-9 .94* 


-.23* 


6 


Available 


-2.02* 


4.24* 




.32 


-.91 


.04 


-1.00 


2.90 


-1.49 












Math 








» 




Not Available 


-.50 


1.15 




.14 


-.10 


-. 70 


. 02 


1 . 20 


- .40 


1 


Ava i *able 


■ X J 




1 


.27 


-.90 


. 96 


- . 52 


-1 . 26 


.01 




Not Available 


-1.14 


-4 .09 


-5 


.54* 


-.59* 


-1 .00 


- 2 . 07 


-4 .84 


- 1 . 27 


2 


Ava i 1 ab 1 e 


.23 


-2.78 


-1 


.03 


-.15 


-1 .99 


- .03 


8.60* 


-1.85* 




Not Available 


1.17 


- .97 


1 


.01 


.51 


4 .66 


- . 38 


-.23 


.88 


3 


Ava i laole 


- 18 


-2. 06 


-1 


.38 


-.29 


1.39 


-1.14 


-7.48 


.35 




Not Available 




2 . 77 




.30 


1.21 


- . 15 


1 . 04 


-1 .74 


1.45 


4 


Available 


2.07 


5.03 


1 


.38 


3.42 


3.50 


2.58 


-4.91 


4.19 




Not Available 


- . 48* 


6.97* 




.07 


1.91 


-1.6 


2 . 27 


.34 


1.63 


5 


Available 


.53 


4.48 


4 


.09 


.40 


13. 6** 


-1.99* 


7.81 


.38 




Not Available 


-2.23 


.11 




.62 


-2.07 


-3 . 19 


-1 .20 


-.61 


-1.95 


6 


Available 


.35 


1.64 


1 


.29 


.41 


-5.57* 


2.50* 


- 30 


.84 










9 Practical 


Achievement 












Not Available 


-.07 


-.21 




.02 


- 14 J 


-.60 


.00 


-.36 


.01 


4 


Available 


-.26 


-.02 






-.26 


-1.09* 


.03* 


.21 


-.29 




Not Available 


.33 


-.24 




.60* 


.44* 


.33 


. 12 


-.38 


.29 


5 


Available 


. 16 


-.16 




.38 


-.06 


.39 


.00 


-.36 


.17 




Not "Available 


-.14 


.28 




.17 


05 


.06 


-.03 


.86* 


-.30* 


6 


Available 


.27 


.31 




.35 


.25 


.49 


.22 


.40 





Group means differ significantly at the .01 level. 
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Comparing Posttest Achievement of CE Students with the Expectation. To assess 
the effectiveness of CE with respect to the standard derived from the predic- 
tion models, the observed mean performance of CE students was. compared with 
the expected mean performance for a hypothetical group of non-CE students with 
identical characteristics. The comparisons were made for all CE students, for 
each of the three categories of CE students separately, and specifically for 
the subgroup of CE students in the nominated schools. As in the norm-referenced 
analyses, the purpose of the special analysis for the CE students from the 
nominated schools is to examine the consequences of combining them indiscrimi- 
nately with the CE students fro^n the representative schools in the evaluation 
of the general effects of CE. 

Tables B5-4 and B5-5 present the results of these analyses for reading and ; math, 
respectively. The detection of the effects of CE follows a similar strategy 
for identification of outliers in the regression analyses. Explicitly, if the 
conditional sampling distribution of the predicted mean posttest score indi- 
cates a small likelihood (e.g., with probability of less than .1) for it to 
exceed the observed posttest score, then we consider it unlikely that the ob- 
served mean posttest score could have been obtained by the CE students without 
CE intervention. By this line of reasoning, an observed mean posttest score 
greater than the upper limit of the 80 percent credibility interval for the 
corresponding expected mean posttest score provides evidence for positive 
effects of CE. On the other hand, if the observed mean posttest score is 
^smaller than the lower limit of the 80 percent credibility interval, we con- 
clude that there is no evidence for positive effects of CE. If the observed 
mean falls between the interval, the evidence for effects of CE is inconclusive. 

For an easier understanding of the results, we also computed the t-ratio (mean 
divided by its estimated standard error) for the difference between the ob- 
served and the predicted mean posttest scores . The magnitude of the t-ratio to 
be considered as an indication of positive effects of CE depends on the signi- 
ficance level. For example, a one-tailed significance test of .10 corresponds 
to a critical value of 1.28 for the sample sizes involved. It is important to 
note that the two* lines of interpretations are not equivalent because the stan- 
dard error of the observed'mean is involved in the computation of the t-ratio, 
but not in the detection of outliers. However, the two interpretations general- 
ly agree with* each other because o.f the large sample sizes. Our discussion, 
being decision-oriented, will follow the first interpretation. 

• Results for Reading. Table B5-4 shows some evidence for overall 
positive effects of CE in grades 1 and 5 when Model A is used to 
set the standard, and in grade 6 when Model B is used. For the 
subgroups of CE students, the analysis with Model A reveals some 
positive effects in grades 1 and 5 for Title I students, and in 
grade 5 for other-CE students. The only noteworthy finding with 
Model B is the positive effects for Title I students in grade 1. 
For CE' students in the nominated schools, positive effects of CE 
are obtained in grades 1 and 5 with both models and additionally 
in grade 3 with Model B. Thus there is no clear evidence that 
CE is particularly effective in the nominated schools. 
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Table B5-4 

Mean Obierved end Expected Posttest Reading VSS for All CE students and by CE 
Category (Expected Posttest Scores Are Computed Based on the Regression Models 
Estimated from Tvo Samples of Non-CE Students in Reading CE and Non-CE Schools)* 



c 

R 


CE 

status** 






REGRESSION MODEL A 


REGRESSION MODEL B 


A 

D 
E 










SE of 


sot 


CI 


T 




SE of 


80% 


CI 


T 


N 


MEAN t> 


PMEAN 


PMEAN 


LOWER 


UPPER 


RATIO 


PMEAN 


PMEAN 


LOWER 


UPPER 


RATIO 




ALL CE 


2,448 


389.72 


386 


72 


1.92 


384 . 26 


369.16 


1.47 


386.76 


2.04 


366.16 


391.37 


.45 


1 


TITLE I 

oce/ti 

CCE/NTI 


1,565 
524 
359 


387.63 
396. 58 
388^79 


380 
399 
394 


82 
17 
27 


2.14 
1.S6 
1.79 


378.08 
397.16 
391.98 


383.57 
401.16 
396.56 


2.96 
-1.21 
-2.19 


363.41 
400.67 
394 . 70 


2.17 
1.69 
2.12 


380. 6 J- 
398.51 
391.99 


386.20 
402.63 
397.42 


1.81 
-1.84* 
-2.16 




CE/NOM 


862 


394.59 


380 


83 


2.28 


377.91 


383.76 


S.40 


363.84 


2.24 


380.97 


386.71 


4.29 




ALL CE 


2 .885 


433.38 


433 


56 


1 .<»3 


431 .22 


435. 89 


-.09 


434 . 18 


2.46 


431 .03 


437. 32 


-. 32 


2 


TITLE I 

cceAi 

CCE/NTI 


1,629 
626 
430 * 


427.17 
448.83 
437.27 


427 
4 SO 
434 


54 
38 
64 


1.97 
1.48 
1.90 


42S.03 
446.49 
432.21 


430.06 
4S2.27 
437.07 


-.18 
-.83 
1.12 


428.52 
450.70 
434.20 


2.84 
1.63 
2.28 


424.86 
448.61 
431.20 


432. IS 
4S2.78 
437.12 


-.46 
-.93 
1.15 




CE/NOM 


905 I 


429.79 


429 


31 


* 1.95 


426.81 


431.61 


.22 


431.60 


2.76 


428.06 


43S.13 


-.62 




ALL CE 


2,707 


4S8.86 


461 


00 , 


1.77 


458. 7 3 


463. 26 


-1 . 15 


459 . 20 


1 .94 


456.72 


461 .68 


-.17 


3 


TITLE I 

oce/ti 

CCE/NTI 


1,762 
50O 
425 


4S3.88 
472. Si 
463.65 


454 :eo 

477.58 
467.46 


1.94 
1.41 
1.67 


4S2.32 
475.77 
46S.31 


4S7.28 
479. 39 
469.60 


-.45 
-2.65 
-1.75 


452.77 
477.02 
46S.19 


2.12 
1.51 
1.66 


450.06 
47S.10 
462.60 


4SS.48 
478.95 
467.57 


.bO 
-2.27 
-.66 




CE/NOM 


819 


4S6.9S 


4S6 


76 


1.99 


4S4.21 


459.31 


.06 


455.33 


2.10 


4S2.64 


4S6.03 


1.55 




ALL CE 


2,214 


481.96 


483 


29 


2.05 


480.06 


483 . 92 


-.62 


481.01 


2.27 


ST 

478. 11 


463.92 


.40 


4 


TITLE I 

oce/ti 

CCE/NTI 


1,354 
451 
409 


47S.02 
494.86 
490.70 


475 
498 
493 


15 
09 
OA 


2.31 
1.6S 
1.83 


472.20 
495.98 
491.60 


476.10 

'500.19 
496.26 


-.05 
-1.43 
-1.33 


472.66 
497.66 
489.65 


2.S2 
1.66 
2.28 


469.64 
49S.S4 
466.74 


476.06 
499.79 
492.57 


.82 
-1.29 
.39 




CE/NOM 


?22 


4t>9.49 


474 


39 


2.24 


471.52 


477.26 


-1.84 


472.06 


2.49 


466.66 


475.25 


-.91 




ALL CE 


2,093 


501.27 


490 


04 


3.76 


485 . 2 3 


.85 


2.94 


501.71 


1.61 


499.40 


S04.02 


-.23 




TITLE I 

oce/ti 

OCE/NTI 


1,275 
42S 
393 


49S.12 
S08.21 


483 
S06 
494 


17 
87 
12 


4.00 
3.03 
3.82 


478. 05 
503.00 
469.23 


468.26 
510.75 
499 . 02 


2.93 
1.90 o 
3.42 


49S.S6 
0 516.23 
505.90 


1.92 
1.59 
1.72 


0 493.12 
514.20 
503.70 


496.03 
S16.26 
SOS. 11 


-.22 
-1.39 
2.02 




CE/NOM 


506 


494. '6 


486 


09 


3.89 


481.12 


491.06 


1.96 


496.99 


1.91 


494.54 


499.44 


•1.16 




ALL CE 


2,105 


527.96 


S32 


31 


1.46 


530.45 


534. 18 


-2.74 


S23.96 


2.01 


S21.38 


S26.S3 


1.69 


6 


TITLE I 

OCE/TI 

OCE/NTI 


1,164 
381 
360 


S18.62 
552.59 
S16.36 


S21.8S 
555.07 
S29.42 


1.62 
1.22 
1.4S 


519.78 
553.51 
527.56 


523.93 
SS6.63 
531.28 


-1.76 
-1.43 
-5.19 


S12.07 
SS0.63 
519. *2 


2.30 
1.43 
2.11 


509.13 
S46.60 
516.63 


S1S.02 
552.47 
S22.02 


2.65 
1.02 
-.35 




CE/NOh 


493 


527.31 


S28.02 


1.61 


525.9b 


530 . 08 


-.34 


518.46 


2.32 


51S.49 


S21.43 


3.26 



Regression Model A - model estimated from l sample of students in readinq non-CE schools; 
Regression > 3el B - model estimated from a sample of non-CE students in reading CE schools; 
PMEAN - predicted 'bean based on the regression model. SE - standard error i CI - credibility interval; 
T RATIO - ratio of the difference between the observed and predicted means to the SE of the difference. 
• * o 
OCE/TI - othor reading CE students in Title I schools; OCE/NTI - other reading CE students in 
non-Title I schools; CE/NOM - any reading CE students in thet noni lated schools. 
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Table B5-5 



Mean Observed and Expected Post test H*th VSS for all <X Students and by CE 
Category (Expected Post test Scores Ax* computed Based on the Regression Models 
Estimated from Two S/iples of Non-CE Students in Math CE and Ncn-CE Schools)* 



CE 
Status* 



ALL CE 

TITLE X 

CCE/TI 

OCE/NTI 

CE/NOM 



ALL CE 

TITLE X 

CCE/TI 

OCE/KTI 

CE/NOM 

ALL CE 

TITLE I 

OCE/TI 

OCE/NTI 

CE/NOM 

ALL CE 

TITLE I 

OCE/TI 

OCE/NTI 

CE/NOM 

ALL CE 

TITLE I 

OCE/TI 

OCE/NTI 

CE/NOM 

ALL C2 
TITLE I 

<vce/ti 

OCE/NTI 
CE/NOM 



1,420 379.08 



780 
429 
211 



924 
514 

167 



374.53 
38?. 86 
382.11 



494 388.01 



1,605 429.13 



421.08 
441.29 
436.24 



553 428.39 



1,659 471.86 



975 
420 
264 



467.59 
478.15 
477.62 



579 469.17 



•1,425 511.89 



725 
436 
264 



503.93 
526.53 
509.57 



368 504.81 



1.376 541.95 



740 
384 

252 



536.23 
554.15 
540.13 



391 539.70 



1.465 578.34 



651 
559 
255 



573.32 
590.48 
564.56 



383 582.79 



REGRESSION MODEL A 



SE Of 
ritEXft 



T 

RATIO 



371.54 

362.75 
384.62 
377.40 

368.24 

427.95 

419.10 
441.13 
436.32 

424.50 

463.66 

452.24 
482.41 
476.03 



369.85 373.23 4.87 



1.61 V 360.69 
.99 383.36 



1.29 
1.63 

1.26 

1.45 
1.02 
1.17 

1.43 

3.82 

4.69 
1.69 
4.32 



375.75 
366.16 



417.24 
439.82 
4 34.82 



458.78 

446.24 
480.24 
470.49 



514.29 

502.38 
528.78 
523.05 

504.89 

538.09 

528.82 
554.28 
540.65 

533.50 

573.90 

561.90 
590.07 
569.10 

568.52 



1.48 

1.7b 
1.19 
1.44 

1.70 

1.71 

1.89 
1.50 
1.59 

1.83 

1.69 

2.05 
1. 14 
1.78 

2.11 



500.14 
527.25 
521.21 



526.40 
552.37 
538.61 



559.28 
588.23 
566.82 



364.82 
385.89 
379.06 



426.33 429.56 



420.96 
442.43 
437.31 



422.67 426.34 



468. r * 

458.24 
484.58 
481.56 



457.99 4.40 452.36 463.61 



512.39 516.18 



504.62 
530.30 
524.90 



502.71 50"*. 07 



531.24 
556.20 
542.68 



531.15 535.84 



571.74 576.07 



564.53 
591.91 
571.38 



565.83 571.22 



5.98 
.68 
1.86 



370.3*2 9.14 



.80 

1.11 
.09 
-.03 

1.98 



2.0;' 

3.17 
-1.71 
.33 

2.40 



-1.32 

.68 
-1.01 
-4.79 

-.03 



535.90 540.28 1.88 



3.04 
-.05 
-.17 

2.22 

2.16 

4.43 
.17 
-1.37 

4.58 



377.43 

369. 19 
389.50 
381.15 

376.13 



424.39 
444.07 
437.74 

432.07 

476.6* 

468.76 
48:.. 44 
487.25 

474.16 

518.95 

508.75 
530.58 
527.73 

509.40 

540.52 

531.23 
557.53 
541.78 

537.42 



573.76 

561.05 
591.31 
567.73 

572.36 



REGRESSION MODEL B 



SE of 
PMEAN 



1.69 

2.03 
1.26 
1.62 

l".86 



375.27 379.60 



367.19 
387.89 
379.07 



3.34 
2.02 
3.57 

2.93 

2.26 

2.67 
1.78 
1.84 

2.67 

2 04 

2.34 
1.75 
1.88 

2.51 



2.96 

3.27 
2.53 
2.87 

3.06 

3.16 

4.23 
1.94 
3.57 

3.49 



420.11 
441.48 
433.17 



465.34 
486.16 
484.90 



505.75 
528.34 
525.32 



52 7.04 
554.33 
538.10 



555.63 
588.82 
563.16 



372.39 
391.12 
383.23 



432.08 2.88 428.40 435.76 



428.67 
446.66 
442.32 



428.32 435.82 



472.18 
490.73 
489.60 



470.74 477.57 



511.75 
.,32.82 
530.14 



536.73 544.30 



535.43 
560.82 
545.45 



533.51 541.34 



569.71 577.81 



566.47 
593.79 
572.29 



568.40 577.32 



T 

RATIO 



.87 

2.03 
-1.83 
.35 



373.75 378.50 5.05 



-.99 

-.94 
-1.12 
-.34 

-1.13 



473.79 479.58 -1.98 



-.40 
-4.10 
-3.33 

-1.63 



516.34 521.55 -3. 



-1.76 
-1.60 
-6.03 



506.18 512.61 -1.43 



.45 

1.35 
-.99 
-.40 

.59 

1.37 

2.70 
-.31 
-.71 

2.42 



Regression Model A - model estimated from a sample Of students in math non-CE schools. 

Regression Model B - model estimated from a sample of non-CE students in math CE schools; 

PMEAN - predicted man based on the regression model; S£ - standard error; CI - credibility interval; 

T RATIO - ratio of the difference between the observed and predicted means to the SE of the difference. 

'OCE/TI - other math CE students in Title T schools; OCE/NTI - other math CE students in non- 
Title I schools; CE/NCm - any math CE students in the nominated schools. 
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These results for reading suggest that uses of models that ex- 
plicitly take student characteristics into account produce 
slightly more stringent standards in grades 2 and 3, In these 
two grades, no positive effects of CE are evident in the current 
analyses, but positive effects were indicated in some previous 
analyses using othtr standards. In contrast, adjustment of student 
characteristics results in some detectable positive effects of CS 
in grade 5 that were not noticeable in some of the previous analyses. 

• Results, for Mqth. Positive overall CE effects in grades 1, 3, 5, \ 
and 6 are observed in Table B6-5 y when Model A is employed. How- 
ever, the results show positive effects only in grade 6 when 
Model B is used. For the three categories of CE students, there 
is evidence for positive effects of CE on the achievement growth 
of Title I students in grades 1> 3, 5, and 6 when Model A is 
applied, and on the growth of other-CE students in other-CE 
schools in grade 17 With Model B, only a few positive effects 
are obtained in grades 5 and 6 for Title I students • For the 
CE students in the nominated schools, the analyses with Model A 
•show positive effects in all grades but grade 4, while the anal- 
yses with Model B reveal positive* effects only in grades 1 and 5. 
Again, it is not apparent that CE in math is more effective in 
the nominated schools. 

In summary, the application of statistical models to set comparison standards 
results in fewer instances of positive CE effects, particularly when the model 
is developed from data for non-CE students in CE schools. This model o may have 
set unusually high standards for the detection of CE effects because its vali- 
dity is affected by the lack of data in the lower end of the pretest score 
distribution. This suspicion/stems from the finding that this model gives 
less satisfactory predictions for the performance of educationally needy non- 
CE students than thor model (Model A) developed with data from n<n-CE schools „ 
(see Tables.E-1 and'E-2 of Appendix E) . The results of analyses with Model A 
generally confirm the findings of other analyses using different approaches 

Analysis for Practical Achievement 

The practical achievement scores for CE students in grades 4 to 6 were also 
analyzed with this approach. As for the reading and math analyses, the 
variables employed in the two prediction models are listed in Table B5-1, and 
\the results of cross-validating the models are reported in Table B5-2 and 
B5-3. Table B5-6 presents the data required for evaluating the rffects of CE 
based on these models, while the findings f;rom these analyser are discussed 
in the text. 
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Table B5-fe / 

Mean Observed and Expected Posttest Practical Achievement Scores for All CE students 
and by CE Cagegcry (Expected Posttest Scores Are Computed Based on the Regression 
Models Estimated from Two Samples of Non-CE Students in CE and Non-CE Schools)* 



G 
R 
A 
D 

E 



CE 

Status** 



ALL CE 

TITLE I 

OCE/TI 

OCE/NTI. 

CE/NOM 

ALL CE 

TITLE I 

OCE/TI 

OCE/NTI 

CE/NOM 

ALL CE 

TITLE I 
OCE/TI 
. OCE/NTI 

CE/NOM 



MEAN 



2,514 14.31 



1,571 
507 
436 

603 



13,75 
15.43 
15,03 

13.55 



2,411 16.80 



1,498 
504 
409 



16.27 
17.94 
17.34 



632 15,97 



2,393 19.15 



1,335 
667 
396 

600 



^.8.42 
20.69 
19.01 

18.71 



REGRESSION MODEL A 



SE Of 
PMEAN PMEAN 



80% CI 



LOWER 



UPPER 



T 

RATIO 



14,62 

13.92 
15.78 
15.80 

14.03 

16.80 

16.34 
17.77 
17.30 

16.85 
18.17 

17.11 
20.18 
18,37 

17.52 



.56 

.61 
.44 
.57 

.62 

.29 

.30 
.25 
.28 

.30 

.36 

.43 
.24 
.35 

.39 



13.90 

13.15 
15.22 
15.07 

13.24 

16.44 

15.95 
17.45 
16.94 

16.46 

17 . 71 

16.56 
19.88 
17.92 

17.01 



15.35 

14.70 
16.34 ' 
16.54 

14.82 

17.17 

16.73 
18.09 
17.65 

17.24 

18.63 

17.66 
20.49 
18.81 

, 18.02 



-.55 

-.29 
-.75 
-1.27 

-.75 

-.02 

-.23 
.53 
.12 

-2.54 

2.67 

2.99 
1.87 
1.67 

2.86 



REGRESSION MODEL B 



PMEAN 



se/ Of 

IJ&EAN 



80% CI 



LOWER 



UPPER 



14.63, 

13.90 

15.8' 

15.7/ 

13.86 

17.63 

17.15 
18.60 
18.21 

17.38^ 

19.11 

18.25 
20.77 
19.21 

18.78 



/ 



,24 

.26 
.19 
.21 

.27 

.24 

.26 
.21 
.24 

.24 

.25 

.30 
.17 
.25 

.28 



14.32 

13.56 
15. b5 
15,51 

13.51 

17.32 

16.82 
18.33 
17.91 

17.07 

18.78 

17.87 
20.55 
18.89 

18.42 



14.93 

14.23 
16.13 
16.05 

14.20 

1^.95 

17.48 
18.87 
18.51 

17.69 

19.43 

18.64 
20.99 
19.53 

19.15 



Regression Model A - model estimated from a sample of students in non-CE schools; 
Regression Model P - model estimated from a sample of non-CE students in CE schools; 

PMEAN - predicted mean based on the regression model; SE - standard error; CI - credibility interval; 
T RATIO - ratio of the difference betwen the observed and predicted means to the SE of the difference. 



-1.28 

'-.53 
-1.79 
-2,62 

-.95 

-3.25 

-3.17 
-2.41 
-2.84 

-4.88 

.15 
.54 

-.66 ~ 
-.25 



OCE/TI - other CE students in Title I schools; OCE/NTI 
CE/NOM - any CE students i n the nominated schools. 



other CE students in Non-Title I schools; 
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Table Cl-1 



Projected Population Mean Proportions of Each Service Composite for 
Reading and Math, by Grade 



Service 



Projected Population Mean Proportions* 



Composite 


Gr. 1 


Gr. 2 


Gr.: 3 


Gr. 4 


Gr. 5 


Gr. 6 






Reading 










K (regular) 

R 


.46 


.42 


.44 


.49 


.48 


.47 


H (special) 


.20 


.21 


.20 


.18 


.16 


.17 


H (independent) 


.34 


.37 


.36 


.33 


.36 


.36 






Math 










H (regular) 

R 


.53 


.50 


.54 


.55 


.54 


.59 


H (special) 

o 


.10 


.13 


.11 


.13 


.15 


.11 


H (independent) 


.37 


.37 


.35 


.32 


.31 


.30 



/ 



These proportions are used to construct patterns of service delivery. 
(See the text in Chapter 3 for explanations.) 
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Table CI -2 

Changes In Correlations Between Achievement and the Standard-Resource-Dollar (SRO) 
Measure of Instructional Services Received During the Year, for Subsamples of Students 
Classified by Pattern of Inst' uctional Servicest 





Correlation Between 








Subsamples by 












Services Measured by 




Pattern 


of Instructional 


Service. 






Total 


Grade 


COn'c Jtnrt Prf»f"f»«5 f" / 


















++ 


Sample 




Post test Achievement 


+ 




+- 


++- 


--+ 


+-+ 






Reading Achievement and Services 
























Pretest 


.01 




06 




00 


.07 


.08 




01 


-.07 




Posttest 


.07 




05 


.02 


. 11 


.11 


.04 


-.07 


1 


t * * 


4.81 


-0. 


81 


0. 


86 


1.86 


2 . 10 


2.24 


1 . 05 




diff 














































Pretest 


-.07 




00 




u 


- . 13 


-.05 




03 


-. 17 




Posttest 


-.08 




01 




07 


-.10 


-.02 




00 


-.17 


2 


t ** 


-0.95 


0. 


71 


-1 


45 


1.53 


2 . 92 


-2 


37 


1 . 16 




diff 






















Pretest 


-.10 




01 


.02 


— .21 


-.19 


-.05 


-.28 




Posttest 


-.10 


.01 




02 


-.18 


-.20 


.00 


-.26 


3 


t ** 


0.28 


1 


55 


-0 


14 


2.11 


-0 . 82 


3 


86 


4 . 50 




diff 






















Pretest 


-.17 


- 


11 


- 


08 


-.18 


-.10 




20 


-.33 




Posttest 


- .16 


_ 


09 


- 


14 


- . 19 






16 


- . 32 


4 


t ** 


1.64 


0 


93 


-2 


76 




1.27 


3 


58 


4.59 




QUI 




















• 


Pretest 


-.17 


- 


08 


- 


10 


-.14 


- . 18 




13 


— . 29 




Posttest 


-.16 


- 


06 


- 


06 


-.12 


- . 18 




12 


— 28 




t ** 


1.93 


1 


51 


2 


21 


2 .66 


0.25 


0 


36 


2.98 




diff 






















Pretest 


- .18 




21 


- 


27 


-.15 


— . 1 J 




18 


- . 30 




Posttest 


-.14 


- 


16 


- 


20 




- . 12 




18 


- . 27 


6 


t ** 


7.36 


4 


.32 


5 


43 


0.42 


1.06 


0.82 


8.24 




Jiff 






















Math Achievement and Services 
























Pretest 


-.03 




.00 




.04 


- .08 


.02 




07 


-.14 




Posttest 


-.00 




.04 




.09 


-.05 


.06 




01 


-.09 


1 


t ** 


2.01 


2 


.26 


2 


.12 


2. 4 J4 


1 .83 


3 


11 


7 . 72 




.diff 






















Pretest 


-.11 




.14 




.04 


05 


.07 




.04 


-.14 




Posttest 


-.14 




.13 




.01 


.10 


.05 




.01 


-.13 


2 


t ** 


-2.82 


0 


.85 


1 


.04 


4.22 


-0 . 90 


1 


.78 


1 . 04 




diff 






















Pretest 


.01 




.01 




.05 




-.10 




.06 


-.15 




Posttest 


.00 




.03 




.11 


- .03 


- .14 




.03 


-.16 


3 


t *• 


-0. 23 


2 


.54 


-2 


.57 


-0.79 


-2 . 08 


1 


.64 


-2.25 




4iff 






















Pretest 


-rn 




.13 




.04 


-.02 


.01 




.09 


-.21 




Posttest 


-■17 




.03 




.02 


-.02 


.03 




.02 


-.17 


4 


t ** 


-3.75 


4 


.96 


0 


.72 


-0.02 


0.69 


5 


.24 


6.19 




diff 




















Pretest 


-.07 




.04 




.03 


-.09 


.02 




.12 


-.19 




Posttest 


-.07 




.C4 




.08 


-.08 


,05 




.08 


-.17 


5 


t ** 


0.30 


0 


.11 


1 


.61 


1.74 


1.77 


3 


.52 


3.43 




diff 






















Pretest 


-.05 




.06 




.04 


-.03 


-.03 




.13 


-.18 




Posttest 


-.03- 




.02 




.06 


-.01 


-.09 




.13 


-.15 


6 


t ** 


3.28 


2 


.54 


4 


.76 


2.12- 


-3.16 


0 


.58 


6.75 




diff ■ 





















] 



^The standard-resource-dollar measure of instructional services is explained in Report 6. 

*The hours of instruction received during the 1976-77 school year were employed t;o form sax patterns of 
instructional services. The instructional services were grouped into three kinds: regular instruction 
(by classroom teachers m groups of 7 or more), special instruction (by special teachers, paid aides/ 
assistants, or by classroom teachers in groups of 1-6), and tutor/independent work. Three variables 
representing the proportions of hours of instruction received in each of the three kinds of services 
were created and then each was dichotomized at the corresponding estimated population value. Because 

< the proportions sura to 1.0/ six mutually exclusive patterns of services were obtained on the basis of 
three dichotomies,, excluding the rare cases where each proportion was equ.il to its respective cutoff 
(mostly due to roundings) . In the Table, a '+' indicates the proportion is above the cutoff, while a 

indicates a value below the cutoff. The instructional patterns are represented by the three indexes 
of '+/-' for regular instruction* special instruction/ and tutor/independent work (arranged from left to 
right). For example, the pattern '+--' indicates that the proportion of regular instructional time is 
above its cutoff/ while the proportions of special inctruction and tutor/independent work are below 
their respective cutoffs. 

**Hotelling's t statistic for the difference between the pair of correlations. 
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Table CI -3 



Average Pretest ^vte». VSS ^ains. Total H^urs of Instructional Services Received, and Standard -Re source Dollar 
Indexes ir. Reading for the 1976-77 School Year, by Grades and Patterns of Instructional Services* 



Patterns of 
Instructional 



Hours of Instructions Received 
as Indicators of Services 





Services 




Pretest 


F-S 


VSS 


Hrs. of 




Pretest 


F-S VSS 


Service 






N** 


vss 


Gam 


Service 


.N** 


VSS 


Gain 


Costs 






4,551 


346.3 


67 


5 


302.1 


4,488 


346.3 


67.9 


294.6 








330 . 9 


58.9 


280 .0 


2 810 


3 30.9 


58 .8 


495 . 2 






1,543 


336.8 


62.9 


301.3 


1.536 


336.9 


63.0 


375.1 


1 




2,347 


351.2 


66 


.3 


309.9 


2/282 


351.2 


66.5 


271.3 




♦-♦ 


2.863 


352.9 


69 


2 


321 .9 


2.848 


352.9 


69.2 


.271.4 






2.670 


345.2 


61 


2 


294.4 


2.630 


344 .9 


61.2 


424.6 




Total 


16 .815 


344.4 


64.8 


301 . 3 


16,594 


344 .4 


64 .9 


349.4 




♦« 


4.229 


422.7 






291.7 


4.194 


422.5 


44.2 


286.8 










42 


_ 2 


2bl .8 


2.734 


39 3 . 9 




529 . 3 






1 .200 


388. 3 


4 1 




292 .9 


1 .197 


388. 3 


41 .8 


393.5 


2 


«*-♦ 


1 .878 


428.9 






271 . 3 


1,821 


428 .8 


42 .0 


253.6 






3.014 


433 .0 


4 3 


_ 2 


296 


2.996 


432.9 


43.3 


254.8 - 






2 .232 


411 .2 


43 


.4 


264 . 4 


2,164 


411.4 


43.5 


400. 3 




Total 


15 . 374 


415. 7 


43 


.1 


284 .4 


15.107 


415.8 


43.1 


345.1 






3.997 


469.4 


32 




2 39.1 


3.908 


470.3 


32.9 


232.4 






2 .620 


426 . 3 


32 




242 . 2 


2.511 












1 .164 


429. 4 


it 




275.6 


1 . 141 


429.8 


36.4 


352 .9 


3 




2.221 


475 .9 




6 


245 . 1 


2 .095 


476.8 


32 .5 


219.6 




♦- ♦ 


2 .899 


484 .6 


34 


. 5 


245. 7 


2.881 


484.7 


34.6 


209.0 






2 . 397 


450.5 


34 


.4 


247.9 


2. 336 


450.6 


34.7 


364.2 




Total 


15,300 


459.8 


33 


.6 


245.9 


14,874 


460. 3 


33.8 


294.9 






4,712 


501.1 


29 


.4 


203.4 


4,679 


500.8 


29.5 


185.1 






1 . 370 




31 


.0 




1 .797 




31 .2 


443 • 3 




III 


930 


459. 2 


31 


,6 


243.6 


918 


459 . 3 


31 .5 


343.7 






2 .614 


514 .0 


29 


.R 


198. 1 


2 .496 


514.7 


29.9 


167.7 






2 .768 


512 .6 


28 


.7 


202 .6 


2,745 


512 .3 


28.7 


172 .8 






2,435 


479. 7 


29 


.3 


217 . 2 


2 . 310 


479.4 


29.6 


322 .2 




.0 a. 


15 . 330 


493 .0 


29 


.7 


209.1 


14.946 


493 . 1 


29.8 


241.9 






5.423 


529.4 


28 


.9 


188.2 


5.372 


529.3 


28.9 


162.6 




-♦- 


1 .968 


479. 7 


24 


.6 


207 . 3 


1 .854 


478 . 7 


25 . 1 


417.8 






1.114 


491.6 


25 


.9 


220.8 


1,086 


491.8 


25.9 


302.0 


5 


— ♦ 


2.505 


544.6 


27 


.1 


192.6 


2.362 


544.5 


27.2 


161.2 






3.014 


542.4 


27 


.2 


194.7 


2,924 


541.9 


27.3 


157.1 




- + ♦ 


2.0:* 


514.4 


26 


.0 


208.6 


1.969 


515.6 


26.2 


303.7 




Total 


16.057 


523.6 


27 


.2 


197.3 


15.569 


523.6 


27.3 


219.3 






6,831 


564.5 


24 


.8 


169.8 


6.752 


565.1 


24.9 


142.0 






2.235 


518.0 


24 


.6 


184.3 


2.133 


519.0 


24.6 


342 .9 






1.341 


5:8.9 


23 


.7 


211.8 


1.298 


520O 


23.5 


283.6 


6 




2,494 


576.9 


26 


.7 


184.8 


2,423 


577.4 


26.9 


145.9 






3,592 


568.3 


25 


.5 


185.0 


3,428 


569.7 


25.4 


146.9 






2,076 


541.2 


25 


.2 


187.2 


2,065 


541.2 


25.1 


273.3 




Total 


18.570 


555.5 


25 


.1 


181.5 


18.100 


556.2 


25.1 


192.3 



Standard -Resource-Dollars 
as Indicators of Services 



Patterns of instructional services are described in terns of t»te proportional distributions of hours received 
in three kinds of instructions - regular, special, and independent ('♦/-' indicates higher/lower proportion 
relative to the population estimates). For detailed explanations, see footnote of Table Cl-2. 
Gains are measured trora fall to spring of the school year. , 

•Sue to exclusions of cases with all three proportions equal to the cutoffs from the pattern categories, total N 
may soaetimes be slightly larger than the sum of N's for the six patterns. The samples for analyses of the two 
Jifferent service indicators are not exactly identical because of differential missing data for the two indicators. 
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Table Cl-4 



and Standard-Resource-Dollar 



Average pretest Scores, VSS oams. Total Hours of InsLruc clonal Services Received. 

Indexes in Math for the 1976-77 School Year, by Grades and Patterns of Instructional services* 



Grade 



Patterns of 
Instructional 
Services 



Hours of Instructions Received 
as Indicators of Services 



Pretest 
VSS 



F-s VSS 
Gain 



Hrs. of 
Service 



Total 



5,230 
2,247 
1,323 
4,153 
1,444 
2.378 
16.775 



3*3. 
315. 
322. 
337, 
336. 
328, 
330. 



61.0 
60.2 
60.6 
62.2 
61.6 
63.2 
61.5 



160.8 
170.9 
163.0 
165.8 
153.6 
164.0 
163.4 



standard- Re source- Do 1 lars 
as Indicators of Services 



Pretest 

VSS 



F-S VSS 
Gam 



5,151 
2,246 
1,105 
4,094 
1.441 
2.357 
16.594 



333.2 
315.2 
322.7 
337.4 
338.9 
328.9 
330.9 



61.1 
60.2 
60.7 
62.3 
61.7 
63.2 
61.6 



Service 
Costs 



111. 
238. 
172. 
103. 
101. 
177, 
140. 



Total 



4,708 
1,893 
808 
3,934 
2.246 
l.lfll 
15.332 



392.3 
378.3 
380.5 
400.3 
401.7 
387.8 
392.8 



57.8 
53.9 
53.4 
54.5 
55.6 
53.0 
55.4 



175.9 
175.8 
184.0 
155.2 
170.7 
168.6 
169.4 



4,665 
1.866 
786 
3.885 
2,243 
1.680 
15.127 



392.3 
378.6 
381.6 
400.1 
401.7 
388.2 
393.0 



,57.8 
54.0 
53.0 
54.5 
55.6 

" 5*3.5 
55.4 



129.8 
256.4 
211.9 
104.5 
110.0 
210.2 
149.2 



Total 



4,439 
1.821 
854 
4,165 
1,650 
2.333 
15,262 



447.8 

423.5 

422 

452 

44C 

436 

443 



57.9 
52.2 
53.4 
61.3 
60.1 
53.1 
57.4 



167.3 
189.2 
188.6 
169.2 
164.3 
171.1 
171.9 



5,316 
1,297 
788 
3.396 
1,438 
2,380 
15,295 



493.8 

457.5 

472 

508 

503 

487 

495 



49.3 
49.0 
51.2 
50.6 
50.6 
51.7 
50.2 



166.1 
196.1 
189.2 
167.8 
169.2 
174.7 
171.9 



4,284 
1,744 
839 
4,160 
1.634 
2,269 
14.930 



447.4 
422.9 
421.9 
452.7 
448.8' 
437.3 
443.2 



58.6 
52.5 
53.8 
61.3 
60.3 
53.5 
57.8 



5.284 
1.237 
763 
3,906 
1.464 
2.330 
14,984 



498.6 

458.3 

472 

507 

503 

4S7 

495 



58.4 
49.6 
50.7 
50.8 
50.7 
51.7 
50.3 



118.0 
273.8 
199.7 
111.6 
110.2 
198.2 
150.4 



118.6 
332.6 
208.1 
114.8 
112 4 
219.5 
154.9 



6,252 
1,416 
631 
3,*82 
1, '99 
2,255 
16.016 



546.7 
505.3 
507.3 
550.8 
551.4 
522.7 
539.6 



44.8 
40.2 
41.3 
44.6 

46.; 

43.8 
44.3 



163.6 
193.3 
187.3 
172.0 
169.9 
177.7 
171.8 



6.149 
1.395 
626 
3.554 
1.756 
2,!78 
15.659 



546. 
505. 
507, 
551. 
551, 
523, 
539 



44.7 
40.3 
41.3 
45.0 
46.4 
44.1 
44.4 



7,715 
1 ,640 
807 
4.213 
1.683 
2.470 
18,52V 



591. 
550, 
559, 
592, 
588 
562 
582 



39.2 
40.9 
38.0 
40.8 
40.0 
40.5 
39.9 



161. 
176. 
173 
162, 
16C 

•*s 

164 



7.373 
L.626 
803 
4.016 
1.631 
2.448 
17.898 



591.2 
551.0 
559.7 
592.8 
587.6 
S62.6 
582.2 



39.8 
40.9 
37.9 
41.2 
41.1 
40.4 
40.3 



1M.A 
J38.S 



118, 
118. 
237, 
157, 



113.2 
294.5 
207.5 
106.1 
107.8 
208.0 
144.8 



Patterns of instructional services are described in terns of the proportional distnbtuions of hours received 
in three kinds of instructions - regular, special, and independent <■♦/-' indicates higher/lover proportion 
relative co the population estirates). For detailed explanations, see footnote of Table Cl-2. 
Gains are measured froa fall to spring of the school year 

# 0ue to exclusions of cases wxtn all three proportions equal to the cutoffs fro* the pattern categories total N 
*ay sooetiaes be slightly larger than the sun of u's for the six patterns. The sanplcs for analyses of the two 
different service indicators arc not exactly identical because of differential nissing data for the two indi.ato 
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Table Cl-5 



Definition of CE Comparison Groups for the Multiple Regression Analyses 
-of the Practical Achievement Scale 



CE Comparison Category in Math* 



in Reading* 


TI/TI 


oryTi 


OCE/OCE 
* 


NCE/CE 


NCE/NCE 


TI/TI 


TI/TI 


TI/TI 


TI/TI 


TI/TI 


II/TI 


OCE/TI 


TI/TI 


OCE/TI 


OCE/TI 


OCE/TI 


OCE/TI 


OCE/OCE 


TI/TI 


OCE/TI 


OCE/OCE 


OCE/OCE 


OCE/OCE 


NCE/CE 


TI/TI 


OCE/TI 


OCE/OCE 


NCE/CE 


NCE/CE 


NCE/NCE 


TI/TI 


OCE/TI 


OCE/OCE 


NCE/CE 


NCE/NCE 


* 

TI/TI = Title I students 


in Title I 


schools; 


OCE/TI = 


Other-CE 


students 



in Title I schools; C ^£/OCE = Other-CE students in other-CE schools ; 
NCE/CE = Needy non-CE students in CE schools; and NCE/NCE = Needy 
non-CE students in non-CE schools. 
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Table Cl-6 

Average Experience and Training for Regular and Special Teachers 
in Reading and Math by Grades Taught* 



Grade 

Taught 



Variables Describing 
Teacher's Qualification* 



Number of years teaching in any school 
Number of years teaching in current school 
Highest earned college degree 
Number of college courses in teaching 
Number of hours of inservice training 



Number of years teaching in any school 
Number of years teaching in current school 
Highest earned college degree 
Number of college courses in teaching 
Number of hours of inservice training 



Type of Reading Teachert 



Regular/ 
in Class 



Special/ 
in Class 



Special/ 
Additional 



Total 



% Variance 
Accounted 
for by Types 



898 
11.03 
6.82 
2.37 
1.31 
10.92 



34 
9.62 
5.09 
2.47 
1.29 
11.41 



145 
10.84 
5.56 
2.6X 
2.41 
23.28 



1,077 
10.96 
6.59 
2.41 
1.46 
12.60 



.10 

.78 
2.4S** 
4.S7** 
S.63** 



866 
11.37 
7.18 
2.42 
1.18 
11.13 



55 
8.31 
4.64 
2.44 
1.55 
10.45 



188 
10.86 
S.55 
2.68 
2.26 
22.41 



I, 109 

II. 13 
6.78 
2.47 
1.38 

13.01 



Type of Hath Teachert 



Regular/ 
in Class 



Special/ 
in Class 



Special/ 
Additional 



Total 



% Variance 
Accounted 
for by Types 



826 
11.11 
6.84 
2.35 

.48 
6.00 



10 
7.00 
4.00 
2.40 
.20 
11.70 



54 
9.26 
5.17 
2.S6 
1.30 
21.80 



890 
10.95 
6.71 
2.37 

.53 
7.03 



.61 

.72 

.31 
4. OS" 
7.82" 



.76 
1.73** 
3.31** 
5.63" 
5.13** 



776 
11.67 
7.37 
2.43 

.52 
6.86 



17 
7.88 
4.29 
2.53 
.53 
7.53 



62 
9.44 
4.81 
2.SS 
1.24 
19.63 



8SS 
11.44 
7.13 
2.44 

.57 
7.80 



.95 
1.6i** 

.44 
3. IS** 
4.94** 



Number of years teaching in any school 
Number of years teaching in current school 
Highest earned college degree 
Number of college courses in teaching 
Number of hours of inservice training 



861 
11.36 
6.90 
2. 45 
1.18 
9. 52 



47 
7.26 
4.40 
2.40 
1.8S 
11.87 



214 
11.58 
5.78 
2. 65 
2.14 
19.97 



I, 122 

II. 23 
6. 58 
2.49 
1.39 

11.62 



1.11** 
1.26** 
2.37** 
5.28** 
5.67** 



771 
11.36 
6.94 
2.44 

.56 
6.40 



18 
6.44 
4.78 
2.S6 
.83 
4.67 



81 
9.27 
S.16 
2.S4 
1.11 
IS. 26 



870 
11.07 
6.73 
2.46 
.62 
7.19 



N 

Number of years teaching in any school 
Number of years teaching in current school 
Highest earned college degree 
Number of college courses m teaching 
Number of hours of inservice training 



813 
11.46 
7. OS 
2. 45 
11 
*.89 



63 
8.73 
4.71 
2.60 
1.68 
IS. 05 



197 
11.43 
S.53 
2.68 
2.24 
19.42 



I, 073 

II. 29 
6.63 
2. SO 
1.35 

11.94 



.69 
1.7S** 
3.06** 
7.22** 
4.50** 



725 
11.59 
7.19 
2.47 

.62 
6.70 



31 
8.48 
4.61 
2.SS 
.61 
9.03 



84 
9.67 
S.27 
2. SI 
1.2S 
16.81 



840 
11.29 
6.90 
2.48 

.68 
7.00 



1.33** 
1.06** 

.37 
2.26** 
3.70** 

1.06 
1.56** 

.13 
2.76** 
4.20** 



Number of years teaching in any school 
Number of years teaching in current school 
Highest earned college degree 
Number of college courses in teaching 
Number of hours of inservice training 



Number of years teaching m any school 
Number of years teaching in current school 
Highest earned college degree 
Number of college courses in teaching 
Number 6f hours of inservice training 



784 

11. 

7.27 
2.51 
1.11 
9.73 



52 
9.40 
5.06 
2.46 
1.77 
10.38 



161 
10. SO 
5.26 
2. 65 
2.09 
18.96 



997 
11.19 
6.83 
2. S3 
1.J1 
11.25 



.52 
2.15** 
1.20** 
S.19** 
4.02** 



703 
11.34 
7.24 
2.52 

.64 
6.40 



40 
7. IS 
4.38 
2.48 
.70 
8.23 



78 
9.36 
4.73 
2.49 
1.08 
16.28 



821 
10. 9S 
6.86 
2. SI 

.68 
7.43 



1.93** 
2.73** 

.06 
1.22** 
4.S5** 



673 
10.98 
6 81 
2. 52 
1.06 
8.96 



70 
9. 59 
5.04 
2.53 
1.64 
15.31 



136 
10.44 
5.07 
2.66 
2 13 
19.18 



879 
10.79 
6.40 
2. 54 
1.27 
21.05 



.30 
1.76** 

.99 
5.99** 
5.17** 



591 
10.85 
6.67 
2. SI 

.66 
6.37 



56 
8.70 
4.73 
2. 54 
.89 
9.30 



62 
11.08 
S.29 
2.48 
1.08 
17.08 



709 
10.70 
6.39 
2. SI 
.72 
7.S4 



.64 
1.37** 

.04 
1.21 
4.37** 



The samples of teachers for different grade*? and different subject «• cas (reading/math) need not be independent, because many teachers taught both 
reading and rath,, and in more than one grade. Grades and subject tt *cas taught were determined on the basis of Student-Teacher Linkage Roster. 
Teachers were designated as regular teacher providing instruction in classes, special teachers providing instruction in classes, or special teachers 
providing instruction in addition to regular classes according to their responses to the teacher questionnaires. Teachers whose responses could not 
be verified by their students' receipt of instruction in the iwC^ectivc category were excluded in the present analyses. 

Data describing teacher's qualification were collected in school yc«r 1976-77. Highest « 0 rned college degree has been recoded as. 1 • less than 
4 years of college work* 2 » bachelor's degree* 3 * Sth year preparation, master's degree, or 6-ycar specialist degree, and 4 - doc tor' «? degree. 
Number of college courses and hours of staff development/inservicc training represent the amount received in the respective subject area (reading/math) 
during the last three years (i.e., from 1973 to 1976 school year). 



Q ces among the three typ«s of teachers arc significant at the .01 level. 
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Table Cl-7 



Correlations Among Achievement, Socio-Cultural Advantage Factor, CE Status, 
and Instructional Services Received for Reading (Above-Diagonal Entries) and 
Math (Below-Diagonal Entries), as Estimated from the Postulated Path Model 



Latent or Observed Variables* 



Posttest (POST) 
Pretest (PRE) 

Socio-Cultural Advantage Factor (SCAT) 
CE Status (CE) 

Hours of Regular Instruction (HR) 
Hours of Special Instruction (HS) 
Hours of Tutor/Independent Work (HI) 



Posttest (POST) 
Pretest (PRE) 

Socio-Cultural Advantage Factor (SCAT) 
CE Status (CE) 

Hours of Regular Instruction (HR) 
Hours of Special Instruction (HS) 
Hours of Tutor /Independent Work (HI) 



Grade 1 

(N ■ 11,920 for Reading; 



11,883 for Math) 



POST 


PRE 


SCAT 


CE 


HR 


HS 


HI 


POST 


PRE 


SCAT 


CE 


HR 


HS 


HI 




.93 


.49 


-.30 


.13 


-.19 


.16 




^.98 


.58 


-.41 


.15 


-.29 


.16 


.87 




.59 


-.33 


.07 


-.20 


.16 


.89 




^.57 


-.44 


.13 


-.29 


.18 


.43 


.49 




-.37 


.08 


-.15 


.23 


.47 


.48 




^.37 


.05 


-.15 


.17 


-.17 


-.19 


-.35 




-.17 


.38 


-.14 


-.23 


-.22 


-.39 




-.10 


; .39 


-.19 


.06 


.05 


.04 


-.13 




-.47 


-.07 


.08 


.03 


-.04 


-.12 




^.46 


-.08 


-.18 


-.22 


-.28 


.37 


-.35 




- -.13 


-.17 


-.15 


-.23 


.32 


-.30 




^-.09 


.10 


.08 


.12 


-.13 


-.14 


-.03 




.06 


.10 


.07 


-.05 


-.17 


-.01 





Grade 3 



(N = 


10,995 


for Reading; 


10,989 


for Math) 


POST 


PRE 


SCAF 


CE 


HR 


HS 


HI 




.95 


.65 


-.48 


.08 


-.38 


.13 


.88 




.64 


-.48 


.09 


-.38 


.13 


.49 


.52 




^■.39 


-.01 


-.21 


.0? 


-.29 


-.31 


-.38 




^.09 


.47 


-.16 


.09 


.05 


-.07 


-.08 




^.41 


-.19 


-.22 


-.21 


-.25 


.43 


-.40 




^06 


.08 


.08 


.13 


-.08 


-.39 


-.04 





Grade 5 





(N - 


11,600 


for Reading; 


11,585 


for Math) 




POST 


PRE 


SCAF 


CE 


HR 


HS 


HI 


Posttest (POST) 




.97 


.o4 


-.*■> 


.03 


-.33 


.07 


Pretest (PRE) 


.93 




.64 


-.44 


.01 


-.34 


.08 


Socio-Cultural Advantage Factor (SCAF) 


.52 


.53 




^ -.34 


-.08 


-.29 


.01 


CE Status (CE) 


-.2° 


-.31 


-.31 




-.09 


.45 


-.04 


Hours ? of Regular Instruction (HR)- 


. w0 


.08 


-.01 


-.09 




-.43 


-.33 


Hours of Special instruction (HS) 


-.2$ 


-.27 


-.24 


.35 


-.47 




,-.04 


Hours of Tutor/Independent Work (HI) 


.01 


.02 


.01 


.01 


-.55 


.03 





Grade 2 

(N = 10,997 for Reading; 



10,973 for Math) 



Grade 4 

(N * 10,846 for Reading; 



10,821 for Math) 



POST 


PRE 


SCAF 


CE 


HR 


HS 


HI 






.61 


-.43 


.08 


-.37° 


.06 


.90 




^^61 


-.43 


.08 


-.38 


.07 


.51 


.50 




^35 


-.00 


-.28 


.01 


-.29 


-.28 


-.30 




^.10 


.51 


-.03 


.05 


.03 


-.03 


-.09 




^.40 


-.38 


-.21 


.-24 


-.22 


.37 


-.43 




^03 


.06 


.06 


.05 


.05 


-.51 


.04 





(N 



Grade 6 
13 , 253 for Reading; 



13,226 for Math) 



POST 


PRE 


SCAF 


CE 


HR 


HS 


HI 




.98 


.61 


-.39 


.05 


-.33 


.01 


.92 




.61 


-.40 


.05 


-.34 


.00 


.46 


.48 




-.36 


-.03 


-.30 


-.11 


-.26 


-.29 


-.30 




-.07 


.44 


-.01 


.10 


.10 


.04 


-.16 




-.40 


-.31 


-.23 


-.25 


-.24 


.38 


-.40 




.02 


.02 


.02 


-.01 


.04 


-.61 


.03 





POST » Posttest achievement factor based on at- ar^d below-level posttest scores; PRE = pretest achievement factor based on at- and below-level 
pretest scores; SCAF * Socio-Cultural Advantage Factor based on race/ethnicity (1 * white; 0 = otherwise), participation in free- or reduced- 
price meals (1 88 participant; 0 * otherwise), and mother's educational attainment (1 * high school graduate or above; 0 " otherwise); 
CE « selection for CE services in 1976-77 school year (1 * CE students; 0 » Non-CE students); HR » yearly hours of instructional services 
received from regular classroom teachers in groups of 7 or more; HS * yearly hours of instructional services received from special teachers 
or from classroom teachers in groups of 1-6, and assistance from paid aides; Ht * yearly hours working with tutors or independently. 
Q rved variables except those associated with the Socio-Cultural Advantage Factors are obtained for reading and math, separately. 
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Table Cl-8 



Modifications of the Basic Model in Order to Overcome Problems of Inadmissible 
LISREL Estimates in the ANCOVA for Reading and Math Achievement 
of CE Students and Non-CE Students Judged as Needing CE* 



Grade 



Model for Reading 



1 
2 
3 
4 
5 
6 



Model for Math 

1 
2 
3 
4 
5 
6 



Constraints Imposed Because the Original Model Yields 
Inadmissible Estimates for Some Parameters* 



Residual variance for latent variable 1 POST 1 invariant over groups 
Residual variance for latent variable 1 POST 1 invariant over groups 
Error variance for observed below-level pretest invariant over groups 
None required 
None required 

Error variance for observed below-level pretest invariant over groups 



None required 
None required 

Uncorrelated errors between at-level pretest and posttest for all groups 
None required 

Error variance for observed below-level pretest invariant over groups 
None required 



Please refer to the text for a description of the basic model. If any inadmissible LISREL 
estimates (e.g., negative error variance, negative residual variance, or correlations with 
magnitude exceeding 1,0) were obtained, the model was modified by adding the constraints 
summarized in this table so as to render the estimates admissible . * POST 1 is the latent 
variable for posttest achievement. 



Table CI -9 

Within-Group Reliability for Reading and Math ?retests as Estimated 
f the Measurement Model in the ANCOVA with Latent Variables* 



Student Group** 



Grade 


Pretest 
Level 


TI/TI 


OCE/TI 


OCE/OCE 


Needy 

NCE/CE 


Needy 
NCE/NCE 


Reading 


Tests 












1 


Below 


.61 < 


.63 


.65 


.56 


.68 




At- 


l 5 


18 


1 8 


. 14 


. 18 


2 


Below 


.59 


.77 


.62 


.57 


.59 




' At* 


• UJ 


77 


. 60 


.58 


.62 




Below 




.94 


.92 


.89 


.88 


3 , 


At 




. 52 


. 43 


. 38 


.35 


4 


Below 


. 77 


.90 


.87 


. 84 


. 89 




At- 




67 


65 


. 53 


. 48 




Below 


.79 . 


.89 


.87 


.81 


.82 


5 


At- 


6? 


.82 


.69 


.71 


. 73 




Below 


.81 


.89 


.83 


.84 


.83 


6 


At- 


55 


71 




. 58 


. 55 


Math 


Tests 














Below 


.77 


.75 


.70 


.61 


.50 


1 


At- 


• o o 


. 38 


. 27 


. 22 


.17 




Below 


.66 


.79 


.80 


.68 


.59 


2 


At- 


. DO 


76 


70 


65 


. 62 




Below 


.69 


.85 


.77 


.70 


.69 


3 


At- 


• 33 


65 


6Q 


57 
• 3 / 


. 49 




Below 


.75 


.92 


.88 


.75 


.74 


4 


At 


.48 


.57 


.61 


. -47 


.43 




Below 


.77 


.87 


.83 


.79 


.78 


5 


At 


.63 


.71 


.67 


.63 


.65 




Below 


.68 


.79 


.49 


.70 


.60 


6 


At 


.49 


• 63 


• 42 


.51 


.47 



The estimates are computed on the basis of the results for the basic 
model (Model A), see the text for a description of the model. 

★ * 

TI/TI = Title I students in Title I schools; OCE/TI = Other-CE students 
in Title I schools; OCE/OCE = Other-CE students in Other-CE schools; 
Needy NCE/CE = Non-CE students in CE schools who are judged as needing 
CE; Needy NCE/NCE = Non-CE students in Non-CE schools who are judged 
as needing CE. 
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(Measurement}. ,<o,7 
V Error 

r 

*>9 



Be low -Level 

Test Score 



Pe si dual 



Pretest*^ 
p Achie vemen t i 
/ V jPRE ) 



'Me* 



'Measurement 
Error 



.46* 



At -Level 
Test Score 



V~~A r 

I Measurement I. , 31— » 

v grror y 

fMeasurement\ 3? 
V Error J * 




Tace/ 
Ethnicity 



Participation 

in Free or ' ^ 
Reduced-Price 
Meals 



.80 A Unique ] 

V Factor J 

.67 A Unique A 
\^ Factor 



Mother* 6 
Educational 
Attainment 



h 



88 1 Unique 1 



V! 



Yearly Hours of 
Instruction from 
Regular Teachers 
in Groups of 7+ 



Nearly Hours of 
Instruction from 
Special Teachers , 
Aides * and in 
Small Classes (1-6) 



Yearly Hours of 
Working 
Independently 
or with Tutors 



(The model applies to data for grades 3 through 6. For grades 1 and 2, the two correlations between measurement 
errors for tesc scores^ are replaced with a single correlation between the measurement errors 
for at-lew*l pretest and below-level posttest scores) 
Figure Cl-1 

Estimated Coefficients (standardized for all Observed and Latent Variables) of the Path Model 
f for Reading Achievement in Grade 4 

'Regression Coefficient "in the Structural Model is Significant at the .01 level. 



f — "\ 1 

I Measurement J— 19 - 

K E " or J 



&« low- Level 
Test Score 



.98 



# Compensatory 
Education 
Roster 



[Measurement}- . ,61 
Error 




Pretest 
Achievement 
(PRE) 



_J At -Level 
Test Score 



V 



.86* 



(Measurement J- . 33 • 
Error 



Below-Level 
Test Score 



•95 
.86 



[Measurement . 
Error 



At Level 
Test Score 



V 




Posttest^ 
Achievement/ 
(POST) 



Race/ 
Ethnicity 



,80-f \ Unique 
Factor 



Participation 
m m Free or ^ 
Reduced-Price 
Meals 



65 



Mother's 
Educational 
Attainment 



< Unique 
Factor 

< Unique 
Factor^ 



Q Residual 3 



1.0 



Yearly Hours.. of 
Instruction from 
Regular Teachers 
in Groups of 7+ 



Yearly Hours of 
Instruction from 
Special Teachers, 
Aides, and in 
Small Classes (1-6) 



Yearly Hours of 
Working 
Independently 
or with Tutors 
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(The model applies to data for grades 3 through 6. For grades 1 and 2, the two correlations between measurement , 
errors for test score* are replaced with a single correlation between the measurement errors 
for at-level pretest and below-level posttest scores) 
Figure Cl-2 

Estimated Coefficients (Standardized for all Observed and Latent Variables) /of the Path Model 

for Math Achievement in Grade 4 
•Regression Coefficient in the Structural Model is Significant at the .01 level. 
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APPENDIX C2 



Mathematical formulations of structural-relation 

» 

i 

MODELS EMPLOYED IN CHAPTER 3 % ; 
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38. 



This Appendix provides the mathematical formulations of the models 
employed tc examine the roles of CE and instructional services in effecting 
achievement growth. 'The first model, illustrated in Figure 3-3, is . 
a general path model that describes the interrelationships among 
achievement, CE status, socio-background, and receipt^ ol instruc- 
tional services- The second model, illustrated in Figure 3-4, is 
an ANCOVA model with latent Variables for comparisons of achievement 
growth among five groups of students (Title I students, Other-CE 
stxidints in Title I schools, Other-CE students in Other-CE schools, 
NorkcE students attending CE schools and judged as needing CE, Non- 
62 Students judged as needing CE but attending Non-CE schools) • 

A GENERAL PATH MODEL FOR READING AND MATH ACHIEVEMENT 

As depicted in Figure 3-3, the model consists of two parts: the 

/ 

measurement model that describes the relationship between latent 
variables (or hypothetical constructs) and their respective observed 
indicators; and the linear structural relations model that stipulates 
the direct and indirect relationships between latent variables. 

The Measurement Model. Following similar notations in Jbreskog 

and SSrbom (1978) , the relationships of the observed variables 

t 

( y and x ) to the latent dependent and independent variables 
( n and 5 , respectively) are represented 'by : - 

v = A n + e , where 5(e) = 0, Sfoe*) = 0 (C2.1) 
and x = A x ? + 6 " , where 5(6) = 0 5(56*) * 0 (C2-2) * 
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i 

o 

The matrices A^ and A^ contain regression coefficients of the observed 
indicators oa the latent variables (in factor analysis, these. coefficients 
are commonly known as factor loadings). The vectors e ard 6 are called 
errors of measurement (or unique factors in the terminology of factor 
analysis). .These error variables may be correlated among themselves, and 
their covariance matrices are denoted as 0 and 0., respectively . The 
covariance matrices of r\ and 5 are denoted as and *^ , respectively, 
■yhus equations (C2.1) and (C2.2) imply that 



I » A $ A ' + 0 . (C2.-3) 

~yy -y ~y ~ z 



Z = A $> A " + e. * (C2.4) 
.XX _x _x ~<5 



and £ = A * r A " (C2.5) 

_yx _y _x 



In the present analysis, the ve^or y contains seven observed variables: 



y^ = Below-level posttest scores 

y^ = At-level posttest scores 

y^ = Below-level pretest scores 

y^ = At-level pretest scores 

y = Yearly hours of instructional services received 
from classroom teachers in groups of 7 or more 
students; 

y = Yearly hours of instructional services received 
^ from classroom teachers in groups of l-o students , 
,or from special teaching staff; 

and y 7 = Yearly hours working with tutor or independently. 

The vector x contains four observed variables: 
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# ^ x ]L = CE status (CE students versus Non-CE students) ; 

x = Race/ethnicity (caucasian/white versus non- 

2 caucasian/white) ; 

% » x = Participation in free or reduced-price meals 

3 (participant" versus non-participant); 

and x = Mother's educational attainment (high school 

4 graduate versus non-graduate) . 



There are five latent variables' in n and two in £ : 

o 

, ni = Posttest achievement with y 1 and y 2 as indicators* 

r\ - Pretest achievement with y 3 and y^ as indicators; 

n = Amount of regular instruction with y & as a single 
3 indicator; 

n = Amount of special instruction with y & as a single 
indicator; 

+ c 

n = Amount of tutor/independent work with y ? as a 
single indicator; 



and 5j = CE status with x^ as a single indicator; 

Socio-cultura 
as indicators 



5 2 = Socio-cultural advantage factor with x 2 , x 3 , and 



Having a single indicator, the three latent variables for instructional 
services and that for CE status are in effect equivalent to their 
respective observed variables. 

Accordingly, eqs. (C2.1) and (C2.2) for the model exhibited in Figure 3 
can be explicitly written as: 



3SU 

./< 360 



and 
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1 
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+ 
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k 











respectively- Note that some elements ^in the matrices A y and A x assume 
fixed values of 1 in order for the model to be identified. 
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The diagonal elements (a* and a* ) of the matrices 0 £ and G> 6 in eqs. 

i i 

(C2.3) and (C2.4) are non-negative. Because y 5 , y 6 , y ? , and x^ have single 

indicators, the error variances for these variables' (a* , o 1 , o 2 , and- ) 

e 5 6 7 1 

are fixed to be zero. The off-diagonal elements (a and a . ) of these c ' 



e . e . 6.6. 
1 3 1 3 



matrices ar } e zero with the following exceptions: 



a ? 0 and c ^ 0 ^ for grades 3 through 6; 
• e l C 3 



£ 2 £ 4 



a ? 0 for grades 1 and 2. 
e l E 4 



The non-zero covariances between the error variables are postulated when 
test scores of the same level are involved. 

The Structural Relation Model. The relationship between the latent 
dependent and independent variables, n and 5 , is represented by: 
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b n « r k + c * ^ (C2.6) 

where E(S) « 0 , S(£c") ■ 0, and B is non-singular. 



The matrices B and r contain regression coefficients, and C is a vector of residuals 

with a covariance matrix V . It follows from eq. (C2.6) that 

(C2.7) r 

(C2.8) . 



b'V <i> r ;+ b^ 1 



and 



* = b" 1 r * 



For the present analysis, eq. (C2.6) can be explicitly written as: 



f 1 -B12 -Bl3 -8m -Bis 1 
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Y 51 
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where the residuals (C) are assumed to be uncorrelated (i.e., V is 
diagonal) . 

In terms of eqs,. (C2.3) to (C2.8) , tjie covariance matrix Z of the 

11 observed variables ( y and x ) can be expressed as a function of the 

unknown parameters in the path model : 



L - 



Z z 
-yy ~y* 



z I 
xy _xx 



A B -1 (r * CP V 0 + *) B* 1 ' A ' + 0^ 
- -SS - - - ~y «e 



-y 



A ' 



-A B r * rr A * 

A * rr A ' + 0 X 
_x „x ..6 



(C2.9) 



Maximum likelihood estimates of the parameters in the right-hand side of eq. 
(C2,9) are obtained with the LISREL IV program, which employs a gradienjt -based 
search algorithm to minimize the function F (negatively related to the likeli- 
hood function of Z) : 



In \Z\ + tr (Z X S) - In S 



(p+q) 



(C2.10) 



where p and q are the number of ' variables in y and x, respectively, and S is 
the unbiased sample estimate of Z. Upon convergence, the information matrix 



ERLC 



3 ( S3 362 



i. 
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is used to compute -standard errors of the parameter estimates. 

* j j 

AN ANCOVA MODEL WITH LATENT VARIABLES FOR THE ACHIEVEMENT OF CE AND COMPARISON 
NON-CE STUDENTS 

In general, LISREL models are employed to analyze deviation scores (i.cj., 
with covariance matrix as input data) and therefore do not deal with mean 
differences when the mode.ls are applied to data "for several groups simultan- 
eously. Although group differences may be examined in terms of path coefficients 
for dummy grouping variables in such models/ the ANCOVA model with latent 
variables ('true score' ANCOVA) presented in Sorbom (1978) allows ex- 
plicit .estimation of means for latent variables and thus direct comparisons 
between group means can be made. As in ordinary ANCOVA, the validity of 
the assumption of parallel within-group regression surfaces that characterize 
the relation between latent variables can be assessed first. Then, if it 
holds, group effects may be compared in terms of adjusted means for the 
latent dependent variables. ■ 



The LISREL IV program was adapted to solve the estimation problem of the 
•true score 1 ANCOVA model. In essence, a variable having a constant value 
of 1.0 is- incorporated into, the LISREL model, and the moment matrices for 
several groups are analyzed simultaneously to obtain estimates of means 
for latent variables as well as the regression coefficients. 

Again, the model includes two parts: the Measurement Model and the 
Structural Relation Model. 

The Measurement Model. The basic model is similar to that of eq. (C2.1) 
with additional parameters for the means. The same observed variables 
explained earlier in the path model are used. However, the dummy-coded 
variable for CE status is no longer needed because students are now - 
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grouped according to their CE statuses and data for separate groups are 
analyzed simultaneously. The same measurement model is applied to each 
group. Because the present model can be presented most conveniently as 



a special case of the LISREI^odel where there are no 'x 1 variables 
(i.e., treating all variables involved as one set), the model for each 
group g is described below in a single equation. For simplicity, the 
superscript (g) for the variables and parameters is omitted. 



*y 2 Uy 

? *x Ux 
0 0 1 



e 

~x 
0 „ 



w = 



(C2.ll) 



where 5 (n) * 6 , 5 (£) = 6 >, 5 (e) = 0, and 5 (we') = 0 



The notations y and x are use<l to keep the distinction between latent 
dependent and independent variables in the ANCOVA setup. 

In the present analysis (see Figure 3-4 for illustration) , y contains two 

indicators (y and y^i for posttest achievement (n) . The vector x contains ( 

two indicators (x 1 and x 2 ) for pretest achievement (£^) , three indicators 

(x , x , and x J for the socio-cultural advantage factor (£J , and one 
3 4 5 z 

indicator (x^, x„, and x_, respectively) for each of the three latent 
6 7 o 

variables* for amount of instruction received (? 3 , ? 4 , and Z,^, respectively). 
Detailed information on these indicators can be found in the preceding 
sectipn (see pages C2-2 to C2-2& . Thus, eq. (C2.ll) for the analysis can 
be written in an expanded form as: 
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The par^ieters X's and u»s are "constrained to be invariant over groups. 

The covariance matrix (0^) for the errors e are allowed to vary with the 

groups, but the last diagonal element is always fixed to be zero because 

the variable '1' is in fact a constant. Furthermore, the variances for e q , 

e , and e . n are also fixed to be zero as the three service variables do not 
9 IP 

have multiple measures. In addition, correlated errors are assumed between 

test scores that involve the same test level (i.e., for grades 1 and 2, 

o is free; and a and o are free- for grades 3 to 6) . 
G 1 E 4 * E 1 E 3 E 2 E 4 . , . 



The Structural Relation Model. This part of the model specifies an ANCOVA 
paradigm for the latent variables. Again, the same model is applied to 
the five analysis groups simultaneously, and is expressed by the equation 
below (the superscript (g) is omitted from the equation) : 
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(C2.12) 



where 



o, 



0, H (^) « <{i , 
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Note that C is the residual for n regressed on £, and.£ r expresses 5 in 

deviation form. The residual variance of n (var(nU)) is and the variance- 

| " - 

covariance matrix of the latent independent variables £ is * . 



The first row in the equation system (C2.12) represents the ANCOVA formulation 

*. 

for n with S as the vector' of covariates. That is , 

- ii-6 +Y*C r +C - a + Y^A, < c2 - 13) 
where a = 6^ ~ . * 

The second, third, and fourth equations in (C2.12) transform the covariates 
into deviations (C ) : C- ■ 5 1 9r • It^raay.-be remarked that the model in 

"* S» "* s s 

♦ (C2.13) is more general than the ordinary ANCOVA because it allows the » 
residual variance '!> to differ among groups. The regression coefficients y 
may be constrained to be invariant over groups to test the assumption of t 
parallel regression surfaces. 

It follows from eq. (02.3,1) and (C2.12) that the moment matrix of 

o 

w = (y' x' 1) 'is I * 

M = A M A'+ 0 , ( C2 * 14 > 

* 



-1 -1' -1 

where M = B [£(C01 B = B 
-uj - . 



IT 1 ' 



« * 

It can be shown from eq, (C2.13) that 'the moment for the latent dependent 

) 

variable n is J 

n n ~ 

Therefore/ it is found that , 

"n- e S--!'^lBr (,,) "^-« I 
as in the case of ordinary regression analysis. 
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The maximum likelihood estimates of 'the unknown parameters in eqs. (62.11) 
and (C2.12) are obtained with the LISREL IV program by substituting M w 
and M for S and I , respectively, in eq. (C2.10) , and minimizing the 
function F. The matrix M w is* th£ sample estimate of the raw moments of 
the observed variables w. Because of the ' inclusion of the constant 1.0 
in the vector w, the last row (and column) in this matrix contain (s) the 
means of the variables y and x. • 
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Table D-l 



linear/ Regressions 'of Reading and Math Achievement Gains on Service Costs ^for the Sample of All CE Students* 



Grade, 



Range and Mean 
of Service Cost 



Miiu 



Max* Mean 



Reading 0 Achieveraent 




* 




1,426 


423 




2 


1,448 


420 




3** 11 


1,596 


383 


" 140 


4 . 72 


1,072 


363 /* 


355 


. 5 * 55- 


1,112 


320 


+ 




1,079 


298 


267 


_ . V 


v 0* 







.1' 


,|# 41 


733 


184 


186 


2 


36 


94*7 


184 




' 3 


"52 


734 


213 - 




4 


59 * 


956 


239 


211 


•5 


42 


935 


235 


129 


.-6" 


49 


1,011 


206 


.166 



Sign of Regression Coefficients or Critical Amount of Effort 
for Four Measures of Gain 



£-Score 'Gain 



Residual Gain A 



Residual Gain 8 



VSS Gain 



+ 

830 
+ 
+ 



+ 
340 

89 
124 



402 



357 
f 

189 



157 

*>34 
231 
137 



+/ 627 
458* 430 

+, 130 
312, 250 



243, 272 

+ # 76 
§2, -100 



Four measures of achievement gains are used: z-score gain - posttest z-score minus pretest *-score, r ^ ual 
qa in- A = observed posttest score mi^us predicted posttest score based»n a prediction model estimated with 
Jata for SS £ non-CE scrtoolsV residual gain B - similar to residual gain' A, but the prediction model 
*\s estimated with data for non-CE students in CE schools; and VSS gain - posttest VSS minus Potest VSS. . 
tostf^ seWces are measured in Standard-Resource-Dollar units on the basis of a resource^ost^odel ^ , 
developed in Technical Report 6* . 
•+• or in the entries of the table represent the sign of the regression coefficient of gain dn cost. 
wL, recession is positive and it is possible to obtain a level of effort within the range of costs in 
SeVaSpleTf S sJuoLrl suc^ that reduc^n in their achievement deficit will be attained the • gentry 
is replaced with the numerical value for this critical level <5f cost (see the text for details of hoW.to 
ftnl Sis vaSeV ^wHuch values may be obtained for VSS gains because two criteria are used for. this 
£M 8 'e of gain 'ba^d on the average^ains for needy non-CE students .in npn-CE and CE schools, respectively. 
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Table D-2 * 
Quadratic degressions of Reading and Math Achievement Gains on Service* Costs 

for the Sample of All CE Students* $ 



, Grade 



Range 1 of Coses Within Which Expected Gain Increases Monotonically With Cost 

for Four Measures of Gain** 



Z-Score Gain 



Residual Gain A 



Residual Gain 5 



VSS Gain * 



Reading Achievement 

1 ' LT 517 

2 LT 580 

3 * LT 658 

4 £, ~ ALL 

5 . LT 698 

6 <*LL 



LT 576 
LT 358 
LT 494 

ALXi 
LT 519 
GT 295 



LT 643 
LT 469 
LT 545 
LT 707 
LT 138 
ALL 



LT 41& 
LT 452 
LT 605 
LT 862 
LT 409 
GT 165 



Math Achievement 

1 LT 341 

2 * GT 308 
3 

4 GT 75 

5 ' ^T 731 

6 ALL 



LT 319 
GT 581 
LT 343* 
GT 154 
LT 681 
ALL 



LT 310 
GT^ 670 
Lf 230 
GT 203 
LT 614 
ALL 



LT 284 

- GT, 327 

GT 142 
ALL 
/ ' ALL 



See Table D-l for explanations of measures of achievement gain and cost for services received* 

* 

A value preceded by 'LT* indicates that for costs less than that value, gam increases with cost; 
while a value preceded by 'GT* indicates that, for costs greater than that value, gain increases 
with* cost, • — • in the entry indicates that, within the range of actual costs for CE students, 
the relationship is negative, while 'ALL; indicates gain increases with cost over the whole range 
of aqtual costs for CE students* * 




Table D-3 



Means and Standard Deviations of the Total Standard Resource- 
Dollar Costs for Instructional Services Received by CE Students* 
# 



/ 

Grade 


Total Cost 


for Reading 


Total cost 


for Math 


Mean 


S.D. 


Mean 


5 *D • 


1 


423 


191 


184 


96 


2 


420 


199 ' 


184 


104 


3 


383 


181 


213 


102 


4 


363 


163 


239 


140 


5 


320 


157 


235 


134 


6 


298 


155 


206 


123 













*These statistics were used to define levels of cost for reading 
and math 'services received. 
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Table D-4 



Keens and worrespond.ng Percentages Itn Parentheses) of Yearly Hour* of Reading services Received per Instructional 
Setting for CU Student*, by tight Uvtls of the Total Standard-Resource-Oollar Cost* for Heading Service* at Each Grade 



Instructional Setting 



Type of Instructor* , Six* 
of Croup (Or H*t*rl«ls Used) 



NusDer of Ct students 

ClassrooaVTeachers, 21 or boi 
CI ess rood Teachers, 14-20 f 
CUiirooe Teacher** 7-1) 
Class roc* Teachers, 1-6 1 
Special Teachers, 7 or sore 
SpecUt Teachers, 1-6 
Aide* or Assistant** 1-10 
Tutor or Adult Volunteer, 1 
Independent, Prograsesed 
Independent, Hon- Progressed 
Total Deeding Services* 



N«ber of CZ Students 

Classrocei Teacher*, 21 or moil 
Classrocei Teacher*, 14-20 
Clessroosi Teachers, 7- 13 
Classrocei Teacher*, 1-6 
SpecUt Teachers, 7 or acre 
Special Teacher* # 1*6 
Aides or Assistant*, 1-10 
Tutor or Adult Volunteer, 1 
Independent, Frog rowed 
Independent, Hon- Prog r«oe»ed 
Total Feeding Services* 



ftssber of Ct Students 

Classrocei Tsachers, 21 or -ore 
Classroon Teacher*, 14-20 
Classrocei Teachers, 7-13 
Classrocei Teachers, 1-6 
Special Teachers, 7 or rore 
Sped*! Teacher*, 1-6 
Aides or Assistant*, 1*10 
Tutor or Adult Volunteer, 1 
Independent, Prograesied 
Independent, Son- Progressed 
Tot* 1 Heading Services* 



Number of Ct Students 

Classrocei Teacher*, 21 or sore 
Classrocei Teacher*, 14-20 
Classrocei Tearhers, 7*13 
Clessroosi Teacher*, 1-6 
Special Teachers, 7 or core 
Specie I Teachers, 1-6 
Aides or Assistants, 1-10 
Tutor or Adult Volunteer, 1 
Independent, Progressed 
Independent, Non-Prograsesed 
Total needing Services* 



V^tber of Ct Students 

Classroo*) Teachers, 21 or sore 
Classrocei Teachere, U-20 
Clessroosi Teacher*, 7-13 
Classrocei Teacher*, 1-6 
Special Teachers, 7 or sore 
Special Teachers, 1-6 
Aides or Assistants, 1-10 
Tutr* or Adult Volunteer, 1 
Independent, Progressed 
Independent, Non-PrograisMd 
Total Reading ^erv»"*s* 



Nusber of Ct Studerts 



Cl**sroc*i Teachers, 2* or *»re 
Classroa* Teachers. 14-20 
Classroo* Teachers, 7-13 
Classroo*) Teacher*. 1-6 
Special Teachers, 7 or eore 
Special Teachers, l-4> 
Aides or Assistant*, 1-10 
Tutor or Adult Volunteer, 1 
Independent, Progressed 
Independent, Non-Prcgrasssed 
Total Reading Services* 



Cost levels Oeflned In Tens of Mean (H) and Standard Deviation <S) of the Distribution of 
Total Service Costs for Ct Students In Each Grade - Each Level Covers the Costs that are 
Greater than the Lower Round (L) but less than or Equal to the Upper Sound (u) Given Below 



Lowest 
4 - l.SS 



l.SS 
1.0S 



• 1.0S 

• o.ss 



• n.SS 
. 1.0S 



> 1.0S 

> l.SS 



M ♦ 1.5? Reading Ct 
Highest Students 



19 




297 




552 




135 




t 198 




254 




154 




205 




2.414 
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17.4 


(5) 


21 1 
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(0> 


2 7 
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1 8 
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2.4 
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1.0 
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4 5 
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1 1 
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2 2 
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10 0 


O) 
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15.1 


(4) 


U 5 
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68 6 


(27) 


77 0 
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59 C 


(17) 
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(1 ) 


** 
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165 5 


188 6 
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254 1 




101 8 




111 1 
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172 




247 
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60 4 
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27 2 
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25.6 
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(8) 
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10 9 
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1) 4 
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50 6 
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49 1 
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iV 


f> 8 


(1) 


17 ) 


:8> 


20 ' 


(A) 
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19 0 
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1.8 
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(1) 
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1 5 
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<M 
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42 1 
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55 9 
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11.1 


(16) 


29 4 
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n.f 
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(11) 


15 7 
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11 1 
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I). ) 
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(22) 
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62 4 
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240 S 
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Discrepancies between the mean total 



EMC 



373 



Table >S 



Instructional SettlwJ 

Type of Instructor*. Sis* 
of Croup (or Katerlels Used) 



Cost Levels Defined In Terms of Hun <M) and Standard Deviation <S> of the Distribution of 
T^tal Service Costs for CE Stents in Each Crede - Each Level Covers the Costs that «• 
Greater then th. Lover *>und (L) but Less then or Equal to the Upper Bound (U) Given Belc 



Lowest 
M - 1.5S 



• 1.5S 
■ l.OS 



• 1.0S 
■ O.S« 



H - O.SS 
H 



H ♦ 0.51 



H ♦ o.ss 

H ♦ 1.0* 



H ♦ 1 .OS 
N ♦ 1.5S 



H ♦ l.SS 

Highest 



All 
Reeding CE 
Student* 



Number of CE Students 

Classroom Teachers. 21 or sort 
Clsssroom Teachers. 14*20 
Classroom Teachers. 7-11 
Classroom Teachers. 1*6 
Special Teachers. > or more . 
Special Teechers. 1-6 
Aides or Assistants. 1-10 
Tutor or Adult Volunteer , 1 
< Independent, Programmed 
Independent. Mon-Progremmed 
Total Heeding Services* 



Slseber of CE Students 

Clestroom Teachers. 21 or sure 
Clsssroom Teachers. 14-20 
Classroom Teachers. 7-1 1 
Clsssroom Teechers, 1-6 
Special Teachers. 7 or store 
Speclel Teacher*. 1*6 
Aides or Assistants. 1-10 
Tutor or Adult volunteer, 1 
Independent. Progressed 
Independent. Non-»rograp»ed 
Totel seeding Services* 



Nis&er of C? Students 
Classroom Teachers. 21 or sure 
Clessroosi Teachers. 14-20 
Classroom Teachers. 7-11 
Class room Teachers. !•<# 
Spec lei Teechers. 7 or more 
Speclel Teachers. 1*6 
Aides or Assistants. 1-10 
Tutor or Adult volunteer. 1 
Independent. Programed 
Independent.. Non-frog reeved 

Total BeeClnq Services* 



1) 

21 9 (21) 
^ l (6) 

13 1 (14) 
S.O (4) 
6 3 (6) 
2 4 (2) 

17 ) (15) 
0 s (0> 
1.6 (1) 

10.9 (10) 
112 9 



297 

18 4 (9) 
IS > (8) 

6o s on 

29 6 (IS) 

S ) (1) 

).9 (2) 

27.2 (14) 

1.8 (1) 

11. S (6) 

24.0 112) 
197 0 



552 

24. ) (9) 
14.2 (5) 
88 0 <)1) 

. 5). 6 (19) 
' 17. 8 (6) 
l).a (5) 

25. ) (9) 
1.6 (1) 
5 0 (2) 

)7.2 <1» 
2'9 6 



5)5 

21 ) (6) 

11 2 ()) 

96 3 (26) 

107.5 (29) 

)1 6 (8) 

3? 5 (10) 

28.0 (?) 

1.8 (0) 

6.4 (2) 

)5.Z (9) 

)74 9 



)9e 

24.6 (5) 
9.2 (2) 

102.8 <22) 

158.5 <>4) 

42.2 (9) 

58.7 (12) 
2S.9 (5) 

2.6 (1) 
7 8 (2) 
40.2 (9) 
470 9 



254 

19.9 (4) 

11.6 (2) 

10) 0 (18) 

212.7 <)8) 

41 ) (7) 

92.6 (17) 

24.2 (4) 

2 1 (0) 

8.9 (2) 

42.2 (8) 
557.4 



154 

12.5 (2) 
18.) <)> 
54 9 (8) 

ill 9 (47) 
20.1 (» 

172 4 (26) 
15 1 (2) 
1.9 (0) 
5.8 (1) 
46.1 (7) 

658 5 



105 

Il.S (2) 
9 9 (1) 
87.1 (10) 
)81 8 (45) 
20 6 (2) 
289.6 <)4) 
8 0 (1) 
0.5 (0) 
6.0 (1) 
)9.9 (5) 
856.5 



2,414 

20.8 (5) 
12.4 O) 

87.9 (21) 
140 6 ())) 

26.0 (6) 
67.0 (16) 
2).9 (6) 
1.8 (0) 
7.1 (2) 
)6.8 (9) 
42). 2 



46 

24 6 (25) 

1.1 ()) 
14 7 (15) 

-\1 (7) 
5 0 (5) 
0 0 (0) 

8.2 <8> 
0 0 (0) 

2) 1 <2)) 
14 5 (14) 
100 2 



)10 

15 1 (9) 

14 7 (8) 

56.6 <)2) 

21.6 (12) 

6.9 (4) 

1.4 (2) 

19 2 (11) 

0.5 (0) 

10 0 (6) 

29.2 (17) 
176 6 



590 

17.1 (6) 

16.4 (6) 

106 0 <)9) 

)).7 (12) 

17.4 (6) 

20.6 (7) 

20.7 (8) 
1.4 (1) 
4.7 (2) 

)7.9 (14) 
274.7 



664 

20.4 (6) 

1) .) (4) 
116 1 <)1) 

75.8 <20) 
24 8 (7) 

50.9 (14) 

2) .0 (6) 
2.5 (1) 
f> 8 (2) 

)7.6 (10) 
)69 6 



516 

26.2 (6) 

7.) t2) 

95.) (20) 

142.4 on 

)5.8 (8) 

90.8 <20) 

20.9 (4) 
2.2 (0) 
8.7 (2) 

36 5 (8) 
465.0 



JOS 
2). 4 (4) 
12.9 (2) 
105 0 (19) 
190 1 <)4) 
47 9 (8) 
119 0 (21) 
20 0 (4) 
2.4 (0) 
7 7 (1) 
)7.1 (7) 
564 5 



167 



12.7 (2) 

10.7 (2) 

96 0 (IS) 

2)5.) 06) 

56.) (9) 

179.) (27) 

20.7 ()) 

1.) (0) 

S.l (1) 

42.5 (6) 

660 0 



216 

10.7 (1) 

4.4 (0) 
52.7 (6) 

4)5.5 (49) 

39.9 (4) 

287.9 <)2) 

11.2 (1) 

1.5 (0) 
6.0 (1) 

)9.7 (4) 
891.1 



2.814 

19.4 (5) 
12.0 O) 
94.7 (2)) 

121 S (29) 

28.5 (7) 
79.0 (19) 
20.) (5) 

i.e (o) 

7.) (2) 
)6.6 (9) 
419.9 



21 

20 1 (21) 

26 3 (27) 

1* 0 (18) 

1.1 (1) 

4 ) (4) 

0 0 (0) 

4 9 (5) 

0 0 (0) 

2 9 O) 

20 J <S0> 
99 1 



12S 

16 8 (10) 

19 ) (12) 

48 7 (JO) 

16 8 (10) 

8 8 (5) 

S 0 ()> 

16.4 (10) 

0.) (0) 

4 1 (3) 

27 6 (17) 
16) 8 



606 

25.1 (10) 

15 1 (6) 

67 4 (27) 

46 ) 119) 

16.7 (7) 

19.) (8) 

2). 8 (10) 

1.3 (1) 

)-4 (1) 

11.$ <1» 
249 2 



5)9 

19 > (6) 
7 8 (2) 
81 8 (24) 
87.4 (26) 
)7 2 (11) 
4) 4 (D) 
19.6 (6) 
0.8 (0) 
5.2 (2) 
)5.4 (11) 
))6 8 



,42) 

22 1 (5) 

11 5 ()) 

9) 8 (22) 

100 2 (23) 

46 4 (11) 

85.9 (20) 

19.8 (5) 
1 ) (0) 
6.) (1) 

40.9 (10) 
427 0 



278 

24.1 (5) 

7.6 (1) 

79.1 (15) 

175 8 <)4) 

42.) (8) 

1)2 6 (26) 

16.7 ()) 

1 7 (0) 

7 ) (1) 

32 4 (6) 
518 9 



186 



"')2.9 (5) 
8.2 <n 
80 7 (1)> 
205.9 <)4) 

44.0 (7) 
17). 4 (29) 

19.6 ()) 
2.7 (0) 
9.0 (1) 

11.1 (5) 
607 1 



214 

11.8 (1) 
1) 1 (2) 
IS. 2 (4) 
))0.6 (42) 

25.0 <)) 
)12.9 <40) 

16.0- (2) 
0.S (0) 

10.1 (1) 
)0.S (4) 

785. 4 



2.592 

21.7 (6) 
12.1 (1) 
71.5 (19) 
108.4 (28) 
)0.1 (8) 
80.7 (21) 
19.5 (5) 
1.1 (0)" " 
S.7 (1) 
)).) (9) 
)8).4 



Number of CE Students 
Clessroom Teechers. 21 or sore 
Classroom Teechers. 14-20 
Classroom Teachers. 7-1) 
ClassrooB Teachers, 1-6 
-Special Teechers, 7 or more 
Special Teachers, 1«6 
Aides or Assistants, 1-10 
Tutor or Adult Volunteer, 1 
Independent, Progressed 
Independent, Non-Programmed 

Total Reading Services* 



6A 

)7 ) 07> 
21 7 (21) 

i 2 in 

1 6 (2) 
5 6 (6) 

2 S (2* 
4 5 (4) 
0 0 (0) 
) 1 O) 

84 2 (24) 
101 9 



266 

)) 0 (20) 

17 9 (11) 

28 6 (17) 

14 6 (9) 

15 6 (9) 
5 9 (4) 

I). 9 (8) 

0.8 (01 

I > (1) 

32 4 (20) 
164 0 



408 
16 4 (7) 

9.5 (4) 
7). 6 00) 
>7.1 (IS) 
24 6 (10) 
27.2 (11) 
17.2 (7) 

0.8 (0) 

4.6 (2) 
)2.) (13) 

242.0 



4)0 

20 7 (6) 
18 6 (6) 
72 8 (2)) 
55.) (17) 
\2 4 (10) 
64 8 (20) 
14 8 (5) 
0 9 (0) 
10 2 ()) 
31 8 (10) 
)21 ) 



)72 

18 5 IS) 

14 ) (4) 

84.2 (21) 

70 8 (18) 

i 45.6 an- 

ill 7 o (29) 
11.2 (3) 
0 7 (0) 
11 2 ()) 
28.5 (7) 

400 8 



247 

17.) (4) 
10 9 (2) 
74 S (15) 

129.6 (27) 
45 1 (9) 

160 6 ())) 
10.1 (2) 
0.8 (0) 

•77 (2) 
28.6 (6) 

484 4 



182 

25.0 (4) 
6.0 (1) 

58.) (10) 
204.8 (36) 

44.8 (8) 
168.5 00) 

11.4 (2) 
1.0 (0) 

D.9 (2) 

29.1 (5) 
562 ) 



159 

19.6 ()) 
9.4 (1) 

49.7 (7) 
)2).0 (44) 

49.6 (7) 

2)9.7 ())) 

6.7 (1) 

2.1 (0) 

4.0 (1) 

22.8 <)) 
726 S 



2.1)0 

21.4 (6) 

11. 5 (4) 

64.4 (16) 
89,1 (25) 
14.1 <9) 

90. 5 (25) 
12.7 (4) 

0.9 (0) 
7.S (2* 
29.9 (8) 
)63.) 



Number of CE Students 

Classroom Teachers. 21 or sore 
Classroom Teachers. 14-20 
Classroom Teachers. 7-1) 
Classroom Teachers. 1-6 
Special Teachers, 7 or "ore 
Speclel Teachers, 1*6 
Aides or Assistants, 1-10 
Tutor or Adult Volunteer, 1 
Independent, Programmed 
Independent, Mon-Proqrasmed 
TOtel heading Services* 



Number of CE Students 
Classroom Teachers, 21 or more 
Classroom Teachers, 14-20 
Classroom Teachers, 7-1) 
Clessroom Teechers, 1-6 
Special Teachers, 7 or more 
Speclel Teachers, 1-6 
Aides or Assistants, l-lo 
Tutor or Adult Volunteer, 1 
Independene, Progremmed 
Independent, Jfen-Proo; rammed 

Totel seeding Services* 



44 

55 5 (70) 

5 8 (7) 

1 > (2) 

0 0 (0) 

C 0 (0) 

0 0 (0) 

1.) (2) 

0 0 (0) 

0 2 (0) 

14 5 (18) 

79 I 



211 

)8 6 00) 

16 9 (1)) 

D.2 (IS) 

6 8 (S) 

6 7 (5) 

) 8 ()) 

9 8 (8) 

0.1 (0) 

7.) (6) 

18.8 (15) 
128.2 



11 

22 0 (47) 

1 0 (2) 

3.4 (7) 
IS 5 (>)) 

0.0 (0) 

0.0 (0) 

0.C (0) 

0 0 (0) 

0.4 (1) 

4.5 (10) 
46.8 



244 

14.7 <)2) 
12 9 (12) 
20.9 (19) 

7.6 (7) 

7.) (7) 

1.8 (2) 

2.8 O) 

0.) (0) 

4.1 (4) 

17.8 (16) 
109.9 



461 




401 




)96 




29.0 


(14) 


27 9 


(10) 


2). 4 


(7) 


16.8 


(8) 


7 8 


O) 


10 6 


O) 


55 ) 


(27) 


62 ) 


(23) 


84 ) 


(24) 


22.7 


(11) 


56.2 


(20) 


71.0 


(20) 


24.8 


(12) 


)5.8 


(1)) 


)S 8 


(11) 


10.8 


<5) 


)5.2 


(1)) 


78.5 


(22) 


11.6 


(6) 


15.1 


(5) 


12.2 


O) 


1.0 


(0) 


1.5 


(1) 


1.4 


(0) 


7.7 


(4) 


5 4 


(2) 


9 5 


O) 


23.7 


(12) 


)0.8 


(11) 


29.9 


(8) 


20). 0 




276 9 




)58 1 




428 




44B 




)28 





190 
18 7 (4) 
10 1 (2) 
60 5 (14) 

122 8 (28) 
20 1 (5) 

152.8 (35) 
10 1 (2) 
0.8 <0) 
11.0 ()) 
26.6 (6) 

4)2.6 



141 

19.1 (4) 

9 ) (2) 

56.9 (11) 

154 7 (J0) 

20 9 (4) 

197 1 <)9) 

IS 8 O) 

0.8 (0) 

11.7 (2) 

26.1 (5) 

511.9 



122 



20.9 (12) 
22 6 (12) 
40 6 (22) 
28.4 (16) 

17.4 (10) 
U.l (7) 

9.4 (5) 
0.6 (0) 
9.0 (5) 

19.5 (11) 
181.1 



21.9 (8) 
26.9 (10) 
5). 7 (21) 
48.) (19) 

21.7 (9) 
)0.6 (12) 
16.2 (6) 

<.] (1) 
7.8 ()) 

26.8 (10) 
257 5 



17 5 


(5) 


20 8 


(5) 


19.4 


(4) 


24.2 


(7) 


21.7 


(5) 


12.0 


(2) 


5) 9 


(16) 


45.5 


(11) 


55. 1 


(11) 


79.0 


(24) 


96 0 


(2)) 


107.6 


(22) 


41 4 


(12) 


56.1 


(14) 


)7 2 


(8) 


69.8 


(21) 


125 2 


00) 


212.2 


(44) 


10.9 


O) 


11.1 


O) 


D.O 


O) 


0.) 


(0) 


1.2 


(0) 


1.) 


(0) 


9.) 


O) 


8.1 


(2) 


5.1 


(1) 


27.6 


(8) 


2) 5 


(6) 


25.7 


(5) 


))).6 




411.) 




487.7 



160 




2.004 




17.7 


O) 


26.7 


(8) 


11 ) 


(2) 


11.9 


(4) 


29 6 


(4) 


55.9 


(17) 


25) 7 


07) 


74.0 


(2)) 


15.2 


(2) 


25.8 


(I) 


111.1 


(46) 


78.7 


(25) 


11.7 


(2) 


12.1 


(4) 


1.7 


(0) 


1.1 


(0) 


7.1 


(1) 


7.9 


(2) 


2). 9 


(4) 


26,1 


(8) 


681.0 




)19^'6 




178 




2,016 




10.7 


(2) 


21.) 


(7) 


11.4 


(2) 


20.1 


(7) 


54.0 


(8) 


45.) 


(15) 


204.5 


()2) 


66.6 


(22) 


41.8 


(7) 


29.1 


(10) 


27). 2 


(4)) 


72.8 


(24) 


8.5 


(1) 


io. e 


(4; 


0.6 


(0) 


1.0 


(0) 


11.6 


(2) 


8.0 


O) 


21.7 


O) 


2).0 


(8) 


6)7.1 




298.1 
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Mean* and Corresponding Percentages (In Par«nth«»i«) of Yearly Hours of Hath Service* Received per Instructional 
Setting for CE Students, by Z\<fA Uvelt of the Total Stendard-Atsource-Oollat Costs for Hath Strvicts at Each Grade 



Inettuctional Setting 



Type of Instructors* Size 
of Croup tor lieteriale Used) Li 



Nunber of Ct Students ; 

Classroom Teachers. 21 or wore 
Classrocei Teachere* 14-20 
C lees rocs Teacher e» 7-13 
Classrocei Teachers. 1-6 
Special Teachers* 7 or sore 
Specie} Teachere* 1-6 
Aides or Assistants, 1-10 
Tutor or Adult Volunteer* 1 
Independent, Programmed 
Independent. Son-Programmed 
Totel Hath Services* 



Coat Levels Defined in Terse of Mean (H) and Standard Oeviation (S) of the Distribution of 
Total Service Costs for CT Students in Each Grade - Each Level Covers the Costs that are 
Greater than the Lower found (L) but Use than or Equal to th« Upper Bound (U) Given Below 



Lowest 
M - 1.5S 



• 1.5S 

• 1.0S 



• 1.0S 

• 0.5S 



• 0.SS 



H ♦ 0. 5S 
M ♦ 1.0S 



H ♦ 1.0S 
M ♦ 1.5$ 



H « 1.5S 
Highest 



Hath CE 
Students 



161 

50.1 (46) 
2-5 (2) 

2.6 (2) 

1.7 (2) 
J. 7 (J) 
0.3 (0) 
7.1 <7» 
1.0 (.) 
1 2 (1, 

18 2 (15) 
108.6 



J15 

46.4 (11) 

19.2 (112 

10.0 (7) 

4.1 (3) 

1.2 (2) 
n * k *i 

14.6 (10) 

2.2 (1) 

0.9 (1) 

46.8 <)2> 
148.5 



; 154 

28.5 (18) 

16.0 (10) 
26.8 (17) 

9.5 (6) 

6.0 (4) 
2.2 (1) 

16.1 (11) 

1.1 (1) 
1.4 (2) 

45.2 (29) 
154.0 



249 

21.2 (1)) 
16.5 (9) 
16 1 (22) 
15.2 (9) 
12.1 (7) 
4.? (J) 
19 4 (11) 
0.7 (0) 
6.1 (4) 
16.7 (22) 
175.1 



25,7 (15) 

11.1 (7) 

16.1 (21) 

27.5 (16) 

7.6 (4) 

5.0 (1) 

20.1 (11) 

0.1 (0) 

5,6 (1) 

15 1 (20) 
176,9 



62 

21.^ (D) 

6.5 (H 
26 6 (14) 
41 6 (22) 

9.6 (51 
11. I (6) 
21 1 (12) 

? 1 (1) 

4.7 (1) 
17.6 (20) 

187 5 



97 
17 6 (8) 
10.1 (5) 
19.4 (9) 
59,7 (27) 
15.4 (7) 
2« 6 (1^> 
18.1 (8) 
2.6 (1) * 
4.0 (2) 
46.0 (211 
221.6 



1.408 

12.7 (20) 

14 1 (9) 

22 9 (14) 

15.5 (10) 

7 2 (5) 

4.7 (1) 

16.3 (10) 

1.3 (1) 

1.4 (2) 
42.1 (26) 

160.4 



number of CE Studtnts 

Classrocei Teachere, 21 or sore 
* Classrocei Teachere, 14-20 
Classrocei Teachers* 7-1) 
Classrocei Teachere, 1-6 
Special Teachere, 7 or aore 
Special Teachere* 1-6 
Aides or Assistants, 1-10 
Tutor or Adult Volunteer* 1 
Independent, Progressed 
Inde pendent,^ Hon-P rograMed 
Total Math Services* 



148 

40.6 <)8) 

1.3 (1) 
1 6 

1.2 (1) 
0.5 (0) 
0.1 (0) 

2.4 (2) 
0.0 (0) 
0.4 (0) 

56 5 (5)) 
106 4 



40) 

50.1 (31) 

17.6 (11) 

10.5 (7) 
2.1 (1) 
0.5 (0) 
0.2 10) 

1C 0 (7) 

0.9 (1) 

12.6 (8) 
46.3 (12) 

152.8 



161 

18.8 (21) 

21.9 (11) 
20.8 (12) 

5.9 (3) 

4.) (2) 

1 6 (1) 

17.) (10) 

1.9 (1) 

7.2 (4) 

52.1 (10) 
171.6 



248 

12.2 (18) 

12.1 (7) 
10,5 (17) 

14.2 (8) 
5.0 {)> 
5.0 <)) 

26.1 (15) 
2.9 (2) 
7.2 (4) 

42.2 (24) 
177 4 



169 

29.0 (15) 

7.5 (4) 

15.6 (18) 

26.2 (11) 

9 4 (5) 

6.7 (1) 

21.4 (11) 

2.0 (1) 

8 0 (4) 

51 1 (26) 
197.1 



10) 

20 5 (10) 

11.7 (7) 

27 1 (1)) 

)1.0 (15) 

15.2 (7) 

18.7 (9) 

16.1 (8) 

5 1 (1) 

).8 (2) 

56.) (27) 
208 0 



112 

)0.0 <1)> 
6.7 ()> 
21.9 (9) 
61.8 (26) 
15.0 (6) 
IS. 4 (14) 
10.6 (4) 
) 7 (2) 
2.0 (1) 
51.8 (22) 
2)7.0 



1.544 

)8.0 (22) 

14.2 (8) 

19.9 (1*2) 

11.7 (8* 

5.1 (3) 

5.6 (!) 

15.2 (9) 

2.0 (1) 

7 4 (4) 

50.1 (29) 
171.4 



Mstber of CE Students 

CUtnoe Teachere, 21 or sore 
Classrocei Teachere, 14-20 
Classrocei Teachere. 7-13 
Classroosi Teachere. 1-6 
Special Teachere, 7 or wore 
Special Teachers. 1-6 
Aides or Assistants, 1-10 
Tutor or Adult Voluntaer. 1 
Independent, Progressed 
Independent. Non-Programmed 
Total Math Services* 



Mumoer of CE Students 
Classrocei Tsachers, 21 or more 
Classrocei Ttachers, 14-20 
Classroom Teachere, 7-1) 
Classrocei Tsachers. 1*6 
Speclel Teachere, ^ or tore 
Spv.el Teachere. 1*6 
Aides or Assistants. 1-10 
Tutor or Adult Volunteer, 1 
Independent. Progressed 
Independent, Non-Prograamed 
Total Math Servlcee* 



Number of CE Studtnts 
Classroom Teachers* 21 or sore 
Classroosi Teachers. 14-20 
Classroom Ttachere, 7-1) 
Claeeroos Teachere, 1-6 
Special Teachers, 7 or sore 
Special Teachers, 1*6 
Aides or Assistants, 1-10 
Tutor or Adult Volunteer, 1 
Independent, Progressed 
Independent. Non-Prograsmed 

Total Math Services* 



Nwber of CE Studtnts 
Classroom Teachers. 21 or sore 
Cleesrocm Teachers, 14-20 
Classroom Teachers, 7-13 
Classroom Teachere, 1*6 
Special Teachere, 7 or sore 
Special Teachere, 1*6 
Aides or Assistants. 1-10 
Tutor or Adult Voluntter, 1 
Independent. Programmed 
Independent, Hon-Prog reamed 

Totel Math Servlcts* 



95.6 (78) 
0.0 (0) 
0.0 (0) 
0.0 (0) 
0 0 (0) 
0.0 (0) 
1.6 (1) 
0.0 (0) 
0 0 (0) 
25 2 (21) 

122 > 



164 
6). 2 (41) 
5 8 (4) 

7.8 (5) 
2 6 (2) 
2.1 (1) 
0.4 (0) 

6.9 (4) 
0 9 (1) 

.6.6 (4) 
5-S.4 ()8) 
154 8 



410 

55 ) (32) 

20.2 (12: 

12.5 (7) 

6.0 ()) 

2. > (1) 

1.7 (1) 

1).7 (8) 



7 2 (4) 
50 9 ( )0> 
171 2 



)4l 

)9.9 (2)) 

14.0 (8) 
18.4 (11) 
15 9 (9) 

9.8 <6> 

4.6 ()> 

D.2 (8) 

2 0 (1) 

)-9 (2) 

52.1 (10) 
174 0 



276 
37.8 (20* 

9.) (5) 
23.* (16), 
18.) (10)' 
11.) (6) 

8.6 (5) 
15.8 (8) 

1.2 (1) 

1 9 ()) 
51.2 (27) 
187 6 



1)5 

)1 2 (15) 

16 7 (8) 

)2 ) (16) 

26.0 (D) 

12 8 (6) 

"12.8 (6) 

16.9 (8) 

0 8 (0) 

8.2 (4' 

44.6 (22) 
202 5 



62 

27 7 U)) 
16 2 (7) 
27 2 (12) 

)0.4 (14) 
12 6 (6) 
24.) (11) 

26.1 (12) 
1.0 (0) 

12.0 (5) 

41 8 (19) 
219 6 



145 

54 4 (22) 
10 8 (4) 
17 5 (7) 
*6 9 (15) 
18.1 (7) 
48.6 (20) 
1) 9 (6) 
0 5 (0) 
4 1 (2) 
)« 1 (16) 
"•41 I 



11^ 

58 4 (40) 

15 7 (11) 

0 7 (o) 

1 4 (1) 
1 0 (1) 
0 0 (0) 
5 2 (4> 
0.) (0) 
5 2 (4) 

58 9 (40) 
146 6 



419 

59.6 ()5> 

16.8 (10) 

9.8 (6) 

).6 (2) 

5.2 <3) 

1 ) (1) 

11.8 (7) 

0.7 (0) 

7 7 (4) 

55 7 ()j; 
172 4 



)0) 

45.8 (26) 

17.7 (10) 

19.9 (11) 

16.5 (9) 
7 4 (4) 

5 7 ()) 

11.6 (6) 
1 8 (1) 

6 5 (4) 

45.8 (26) 
178 7 



212 

45 6 (2)) 

11.0 (5) 

)0.2 (>5> 

17 9 (9) 

21 9 (6) 

11 5 (6) 

o 6 (5) 

0 7 (0) 

15 4 (8) 

4>.l (24) 

202 8 



1)4 

55 4 '22) 

10.1 <4) 

41 ) (16) 



18 



(7) 



6 9 O) 

27 4 (11) 

16 0 <w 

1 4 (1) 

1) ) (5) 

64 2 (25) 

254 4 



64 

)t> 9 (16) 

7 7 ()) 

26 6 (12) 

JO 6 (14* 

» 8 (4) 

Ai 1 (20) 

io a (5) 

1 ) (i> 

14 ) (6) 

44.8 (20) 
22b 2 



117 

*5 6 (1)) 
10.2 (4) 
24 4 (95 
79 2 (29) 
18 0 (7) 
)<> 9 (14) 
11 4 (4) 
6 7 (2) 
11 7 (4) 
)8 t\(14> 
276 2 



1.555 

46.1 (25) 
14.0 (8) 

19.2 (10) 
15.9 (9) 

8.5 (5) 

10.0 (5) 

14.2 (8) 

1.2 (1) 

6.0 ()) 

49.8 (27) 
185.0 

1,)59 

50 7 (26) 
14.) (7) 
19 6 (10) 
17.8 (9) 

7 8 (4) 

11.7 (6) 

11 2 (6) 

1.5 (1) 

9.7 (5) 

51 6 (26) 
196.0 



12) 

109.6 (78) 

> 0 (2) 

0.8 (1) 

0.) (0) 

1 0 (1) 

0 2 (0) 

).7 ()> 

0.5 (0) 

0 4 (0) 

21.0 (15) 

140 7 



)51 

61.9 <)8) 

14 7 (9) 

15.3 (9) 

4 ) <)> 

6 1 (4) 
1.8 (1) 

14.2 (9) 

1 5 (1) 

7 3 (4) 
)6.9 (22) 

164 1 



)05 

45 0 (24) 

8.5 (5) 
II. I (17) 
1).) (7) 

9.6 (5) 
6.1 (!) 

15.5 (6) 

1.6 (1) 

11.1 (6) 

46 ) (25) 
188 2 



2)3 

28. A (14) 

7.1 ()) 

)9 ) (19) 

25 9 (1)) 

12.5 (6) 

11.) (5) 

9 6 (5) 

1.1 (1) 

14.1 (7) 

56 4 (27) 
206 5 



125 

42.5 (21) 
7 1 ()> 

18 9 (91 

41 ) (20) 

12 2 (6) 
2) 5 

8.9 (4) 

2 9 (1) 

4 9 (2) 

41.6 (20) 
20) a 



76 

5) 0 (22) 

2 6 (1) 

29 4 (12) 

)2 0 (1)) 

19.) (8) 

46 ) (19) 

16 6 (7) 

2.5 (1) 

9 9 (4) 

28 9 (12) 
241 2 



9) 

46 9 (17) 
14.6 (6) 
.'1 4 (6) 
46 6 (17) 
11,1 (4) 
76.9 (29) 
IS. 4 (5) 
) 5 (1) 
6 2 ()) 
25.4 (9) 
268 Q 



1.312 

5) 1 (28) 

9,4 (5) 

2) 5 (12) 

18.2 (10) 

9.) (5) 

14.7 (8) 

12.) (6) 

1 7 (1) 

8.7 (5) 

40.2 (21) 
191 I 



118 

71.0 (56) 
17.4 (14) 
0.6 (0) 
0.6 (0) 
0.2 (0) 
0.2 (0) 
2.6 (2) 
0 6 (0) 
4 ) ()) 
29.) (23) 
136 P 



414 

65.1 (41* 

11.5 (7) 

4.3 ()) 

5.6 (4) 
).7 (2) 
1.3 (1) 
7.0 (4) 

1.7 (1) 
14.7 (9) 
4).l (27) 

158 0 



)85 

39 7 (24) 

16.4 (10) 
17 6 (11) 

15.5 (9) 
10 7 (7) 

) 3 (2) 

9.7 (6) 

1.1 (1) 

10.1 (6) 

)9.8 (24) 
164. C 



212 

52.1 (17) 
7 2 (4) 

)1 7 (17) 

16.8 (9) 

17.2 (9) 
8.9 (5) 

15 ) (8) 

).7 (2) 

9.4 (5) 

41.1 (2)> 
166.0 



10) 

15 4 (6) 

8.1 (4) 

19.9 (11) 

40.0 (21) 

15 2 (6) 

15.3 (8) 

20.4 (ID 
2.4 (1) 

14.9 (8) 

)6.) (19) 
168.4 



82 

17 5 (9) 

24.5 (12) 

)0.5 (15) 

42.2 (21) 

12.8 (6) 

24 1 (12) 

11.5 (7) 

2 0 (1) 

6.4 ()) 

29 ) (14) 
20) 0 



12) 

28 7 (11) 

18 ) (7) 

54 7 (21) 

)) 8 (13) 

45 8 (17) 

52 6 (20) 

) 2 (1) 

1 1 (0) 

2.1 (1) 

2) ) (9) 
26). 6 



1.4)7 

44.5 (25) 

1).8 (8) 

18.5 (11) 

16.4 (9) 

12.2 (7) 
9.6 (5) 
9.6 (5) 
1.8 (1) 

10.3 (6) 
)8.1 (22) 

175.0 



The percentages ere obtained as i 
hours of strvices end the sum of 



■ean hours in 
Mans in the 



tach setting divided by mean total hours and then sult.pliad by 100 0 icrtpancies between the Man total 
10 stttings, and discrepancies between the sum of the 10 percentages and 100 arc due to rounding errorc 



MC 



' >100 

375 • 



i 



Table D-7 

Means .ndi Corre.poMirvj Percentage* (In Parenthesis) of Stenderd-ResourceOoller Cost* of Math Service, received 
per Instructional Setting for 02 Students by Eight Uvtli of the Total Oo»t» for Math Services *t Each Grade 



Instructional Setting 



Type of Instructor* • Sis* 
of Croup (or Materials used) 



Kuaber of ct Students 
Classroca Teachers. 21 or pore 
Classroca Teachers. 14-20 
Classroca Teacher.. 7*13 
Cl-ssroca Teacher.. 1-6 
Special Teachers. 7 or *° r W< 
Special Teachers. 1*6 
Aides or Assistants. 1-10 
Tutor or Adult Volunteer. 1 
Independent, Froqruied 
Independent. Hon- Progressed 

Total Math Services* 



Nuaber of CE students 

Clessroo* Teachers. 21 or sure 
Classroca Teachers. 14-20 
Classroca Teachers. 1 J 
Classroca Teachers. 1-6 
Special Teachers. 1 or aore 
Special Teachers. 1-6 
Aides or Assistants. 1-10 
Tutor or Adult Volunteer. 1 
Independent, Progressed 
Independent. Hon-Progra— aed 
Total Math Services* 



Cost Levels Defined In Terms of Hean <M> and Standard Deviation S) of the Distribution of 
Total Service Costs for CE Student* In Each Grade - Each Level Covers the Costi that are 
Greater than the Lover Bound (L) but Less than or Equal to the Upper ftwnd <u> Given sale- 



Lowest 
H • 1.5S 



H - 1.0S 
H - O.SS 



H ♦ O.SS 
H ♦ 1 .OS 



M ♦ 1.0S 
H ♦ l.SS 



M ♦ l.SS 
Highest 



Ml 
Math CE 
Students 



Ifcl 



(40) 
2.0 <3) 
3.4 (S) 
S.4 <8) 
4.4 (7) 
0 7 (1) 
6.2 (9) 
O.S (1) 
(>.6 (1» 
(26) 



27 



11 



J1S 

29.1 (25) 
16.) (14) 
12.9 (11) 
11.4 (12) 
1.4 ()) 
2.9 (3) 
12 6 (11) 
1.0 (1) 
O.S (0) 
23.1 (20) 
115 2 



IS 4 

18.6 (12) 
14.4 (9) 
36.4 (23) 
29 1 (18) 
9.4 (6) 
10.4 (7) 
14.3 (9) I 
0.4 (0) I 
1 8 (1) 
22.9 (IS) 
1S7.8 



249 

14.8 (7) 
IS 2 <7) 

52.2 (2S) 

47.0 (23) 

19.3 (9) 
18.2 (9) 

17.1 (8) 
0.3 (0) 
3.5 (2) 

19 6 (9) 
207.) 



vo 

17.0 (7) 
1) 3 (4) 
$5.4 (22) 
91.6 (36) 

16.1 (6) 
19.5 (8) 
18 5 (7) 

0.1 (0) 

3.4 (1) 

19.5 (8) 
252.4 



62 

16.4 (5) 
6.2 (2) 

40.8 (14) 

1)2.7 (44) 

14.7 (5) 

42.8 (14) 

21.5 (7) 
1.) (0) 
2.7 (1) 

21 0 (7) 
JO0.1 



97 

12.6 (3) 

9.4 (2) 

29.2 (7) 

201.1 (46) 

31.) (7) 

111.4 (25) 

16.0 (4) 

1.1 (0) 

2.2 (1) 
24.) (6) 

4)8.8 



Nvefeer of CE Students 
Cla.sroc* Teachers. 21 or store 
Classrccsi Teachers, 14-20 
Classroom Teachers. 7-1) 
Cla.srooa Teachers. !•* 
Special Teachers. 7 or aore 
Special Teachers. 1*6 
Aides or Assistants, 1-10 
Tutor or Adult Volunteer. 1 
1 nde pe nd en t , ' P r og r amed 
Independent, Mon-Prog ranted 

Total Hath Services* 

luaber of CE Students 
Classroca Teachers. 21 or store 
Classroca Teachers. 14-20 
Classroca Teachers. 7-13 
Classroca Teachers. 1*6 
Special Teschers. 7 or wore 
Specisl Teachers. 1-6 
Aides, or Assistants. 1-10 
Tutor or Adult Volunteer, 1 
Independent. Progressed 
Independent, Non-Prograa»»ed 

Total Math Services* 



148 

25 8 (40) 
2.7 (4) 
2 ) (4) 
4.2 (7) 
0.5 (1) 
0.2 (0) 
2.0 ()) 
0.0 (0) 
0 1 (0) 

:6.8 (4?) 

64 5 



40) 

)1.9 (30) 
14.6 (14) 
13.9 (13) 
6 ) (6) 
0.6 (1) 
0 4 (0) 
9.0 (8) 
0.4 (0) 
6.2 16) 
23.2 ^22) 
106 5 



361 
26.2 (17) 
1' 8 (12) 
29.0 (19) 
19.5 (13) 
8/4 (5) 
6.0 (4) 
15.0 (10) 
0.8 (1) 
) 8 (2) 
26.7 (17) 
15) ) 



248 

21. rt (10) 
10.9 (5) 
4) 9 (21) 
45.7 (22) 
1) 0, (6) 
22 0 (11) 

22.6 (11) 
1.) (1) 
4.1 (2) 

21.7 (11) 
206 2 



169 

17.6 (7) 
6.8 ()) 
51 3 (20) 
86.4 ())) 
24.2 (9) 
24.) (9) 
18.1 (7) 
0.9 (0) 
4.6 (2) 
24.8 (10) 
259 1 



10) 
12.8 (4) 
11 7 (4) 
)7 ) CIS. 
101.7 <))) 
29.1 W 
7) 6 (24) 
11.4 (4) 
2 3 (1) 
1 8 (1) 
26 6 (9) 

no 5 



18.6 (4) 

6.0 (1) 

)0.7 (7) 

20) .4 (46) 

24.2 (5) 

1?5.2 (28) 

8.9 <2) 

1.6 (0) 

1.0 (0) 

24.0 (5) 
44).; 



1.408 

20.6 (11) 

12.5 (7) 

32.2 (17) 
50.0 (27) 

11.8 (6) 
18 5 (10) 
14.4 (8) 

0.6 (0) 

I. 9 (1) 

21.3 (12) 
183. S 

1.544 

24.4 (13) 

11.9 (6) 
28.0 (15) 
44.9 (24) 

10.6 (6) 

21.7 (12) 

II. 2 (7) 
0.9 (0) 
).9 (2) 

24.6 (13) 
184.2 



44 4 (83) 

0. 0 (0) 
0 0 (0) 
0 0 (0) 
0 0 (0) 

o o <n> 

1. ) (2) 

0 0 (0) 
■Jt) 0 (0) 

7 9 (15) 
53 6 



164 

)7.0 <)8> 
4.7 (5) 
9 9 (10) 
7.0 (7) 
1 6 (2) 
1 2 (1) 
5 ft <6) 
0 4 (0) 
).) ()' 

25.8 (27) 

J6 5 



410 

)4.0 (25) 
17.0 (13) 
16 2 (12) 
18.4 (14) 
4.0 O) 
5.9 (4) 
11 3 (8) 
0.5 (0) 
).7 ()) 
23.8 (18) 
134 8 



)41 

24.9 <13) 
1) 4 (7) 
25 1 (D) 
50.6 <27) 
17.9 (10) 
16 2 (9) 
11.2 (6) 
0 8 (0) 
2.1 (1) 
25 5 (14) 
187 8 



276 

?4.5 (10) 

8.6 (4) 

40 9 (17) 

58.5 (25) 

26.5 (U) 

)4 5 <ir>> 

13.8 <6\ 

0.5 (0) 

2 6 (1) 

25.1 (11) 
2)5 5 



1)5 
21 2 (7) 
14. to (5) 
46 { (16) 
85 1 ()0) 
24 4 (9) 
49.4 (17) 
15.9 (6) 
0 4 (0) 
5 0 (2) 
22.8 (8) 
285 6 



82 

17 6 (5) 

15.1 (4) 

38 6 (11) 

98 6 <29) 

21.1 (6) 

92.7 (27) 

24 3 (7) 

0.4 (0) 

7 I (2) 

21.7 (6) 
3)7 5 



145 

34 1 (8) 

9.6 (2) 

24.9 (6) 

123.2 <27) 

34.3 (8) 

187 9 (42) 

12 6 (3) 

0.2 (0) 

2.6 (1) 

19. J (4) 
448.7 



1,555 

28. T (13) 

12.4 (6) 

26.5 (12) 
51.1 (24) 
16 3 (8) 
38.0 (18) 
12.3 (6) 

0.5 (0) 

3.3 (2) 

24.0 (11) 
213.2 



110 

34 ft (41) 

11.8 (14) 

0 9 (1) 
3.5 (4) 

1 0 (1) 
0.1 (0) 
4.4 (5) 
0 1 (0) 

2 5 (3) 
24.7 ()0) 
8) i 



419 

41.1 (30) 

15.) (11) 

13.3 (10) 
11.9 (9) 

6 4 (5) 

4.7 (3) 

10.4 (8) 
0 3 (0) 
4 4 (3) 

27 4 (20) 
1)5.2 



)0) 

)0.4 ( 5) 

16.1 (8) 

27 9 (14) 

52 3 (26) 

17.5 (9) 

20 8 (10) 

10 2 (5) 

0 7 (0) 

) 9 (2) 

22.8 (11) 
202 7 



212 

32.9 (12) 

10.1 (4) 

44 3 (16) 

56 8 (21) 

)9 4 (15) 

41.8 (16) 

H.2 (3) 

0.4 (0) 

9 8 (4) 

24 8 (9) 
268 6 



1)4 

34 7 (10) 

8.4 (2) 

59.8 (17) 

64.5 (19) 

15.0 (4) 

10) 5 <)0> 

13 4 (4) 

1 1 (0) 

7.9 (2) 

3). 2 (10) 
341 4 



64 

23.9 (6) 
7.0 (2) 

37.5 (9) 
.00.9 (24) 

20.9 (5) 
179 3 (43) 

10.4 (3) 
0.6 (0) 

10 7 ()) 

22.0 (5) 
41) 4 



117 

24.7 (4) 
9.2 (2) 

)7.5 (6) 

271.2 (47) 

38.8 (7) 
155.2 (27) 

11.6 (2) 
3.6 (1) 
8.0 (1) 

20.7 (4) 
580.5 



1.359 

14.1 (14) 

12.8 (5) 

28.2 (12) 

58.9 (25) 
17.9 (8) 
44.6 (19) 

9.9 (4) 

0.8 (0) 

5.9 (2) 

2b. 5 (11) 
2)8.6 



Vuaber of CE Students 

Classroca Teachers. 21 or sore 
Classroca Teachers. 14-20 
Classroca Teachers. 7-1) ' 
Classroca Teachers. 1*6 
Special Teachers, 7 or aore 
Special Teachers, 1*6 
Aides or Assistants. 1-10 
Tutor or Adult Volunteer. • 
Independent, Progressed 
Independent, No n* Programed 
Tofal Math Services* 



Nusber of CE 'Students 
Classroca Teachers. 21 or aore 
Classroca Teachers, 14-20 * 
Classroca Teachers. 7-13 
Classroca Teacher*. 1*6 
Special Teachers. 7 or avore 
Special Teachers. 1-6 
Aides or Assistants. 1*10 
Tutor or Adult Volunteer. 1 
Independent. Prc:r**e*ed 
Independent, Mon-Progra*aed 

lotel Math Services* 



12) 

55 6 (77) 

2.1 ()) 

0.9 (1) 

1.1 (2) 

0 7 (1) 

0.5 (1) 

2 9 (4) 

0 2 (0) 

0.2 r» 

8 0 til) 
72 3 



)s: 

)9 7 (29) 

12.4 (9) 

20 6 (15) 

12 9 (10) 

8.1 <6) 

6.8 (5) 

11 9 (9) 

0 7 (1) 

3 9 (*) 

17.7 (13) 
134.9 



305 

27 5 (14) 

2.8 (4) 
44.6 (22) 
42.6 (21) 
12.9 (6) 
20.1 (10) 
14.3 (7) 
0.8 (0) 
6 4 (3) 
23.6 (12) 
200 6 



2)3 
18.2 (7) 

6.5 (2) 
53,7 (20) 

81.1 (31) 

18.2 (7) 
42 3 (16) 

8.5 <3) 
0.5 (0) 
7.8 (3) 
27 1 (10) 
264 0 



125 

27 5 (8) 

6 0 (2) 

25 7 (8) 

137.0 (41) 

19.0 (6) 

82.2 (25) 

8 3 (2) 

1 6 (0) 

3.5 (1) 

22.0 (7) 



76 

35 7 <9) 
2.2J1) 
43.4 (11) 
103.4 (25) 

24 5 (6) 
160 6 ()9) 
14,9 (4) 
1.1 (0) 
6.4 <2) 
14.6 (4) 
406.7 



99 

32.8 (6) 

13.1 (2) 

31 7 (6) 

158.5 (28) 

17.8 ()) 

281.4 (49) 

12.6 (2) 

2.0 (0) 

5.2 (1) 

11.4 (2) 

568.7 



1.312 

32.6 (14) 

8.2 (3) 

)2.9 (14) 

58.9 (25) 

1).0 (6) 

52.4 (22) 

10.9 (5) 

0.8 (0) 

5.0 (2) 

19.8 (8) 
234.5 



414 



)7.7 


(57) 


42.9 


()7) 


10. ) 


(16) 


10.4 


(9) 


0.6 


(1) 


5.2 


(5) 


1.4 


(2) 


15 7 


(14) 


0.1 


(0) 


4.) 


(4) 


0.7 


(1> 


).6 


()) 


2.1 


()) 


6.1 


(5) 


0.2 


<0) 


0.6 


(1) 


2.2 


{)) 


7 ) 


(6) 


10-7 


(16) 


20.1 


(17) 


66.0 




116.3 





)85 

25 7 (15) 

15 1 (9) 

23.9 (14) 

48.3 (J7i 

W.5 (10) 

11.7 (7) 

8.5 (5) 

0.5 (0) 

5 3 (3) 

19.0 (11) 
175.6 



212 

21 5 (9) 
6.7 (3) 
46.7 (20) 

56.0 (24) 

25.2 (11) 
34.6 (15) 

14.3 (6) 
2.2 (1) 
5 4 (2) 

23.1 (10) 
235.7 



103 




82 




123 




1.437 




9.6 


O) 


11 6 


()) 


17.7 


()) 


28.4 


(14) 


7. ) 


(2> 


22 8 


(6) 


16.0 


()) 


12.) 


(6) 


27.3 


(9) 


4). 7 


(12) 


83.2 


(16) 


26.4 


(13) 


126.7 


(42) 


1)7 4 


(39) 


112.2 


(22) 


lrf.4 


(25) 


26.4 


(9) 


22.5 


(6) 


83.0 


(16) 


19.9 


(10) 


57.9 


(19) 


87.) 


(25) 


181.2 


(16) 


)4.0 


(16) 


17.1 


(6) 


11.8 


(3) 


3.2 


(1) 


8.5 


(4) 


1 2 


(0) 


1.1 


(0) 


0.6 


(0) 


0.9 


(0) 


8.6 


O) 


3.5 


(1) 


1.5 


(0) 


5.4 


(3) 


17.7 


(6) 


14 4 


(4) 


U.O 


(2) 


18.2 


(9) 


299.7 




356.1 




509.5 




206.1 





# The percentage, are obt.,r*d a. the ratio (expressed In percent*) of se.n costs , In each 
IS st. of cost, for the 10 Instructional setting., and discrepancies batmen sua of the 



setting to seen total coats. Discrepancies between total costs 
10 percentages and 100 are due to rounding errors. 




40 X 



376 



and Corr.apondlng Nrc.nt.f.1 (In r.renthe.l.) of T.arly Hour, of ^ing Service. *~.lv.d £ ""f!. ? .t^cTcra! 
l ^J^Sp.cUir.~J^ U tor/!iv4.p.nd«r»t). by Ct Categorle. »nd four Uv.li of the Total Co.t, for Seeing Service, at tach Grade 



* Coat 
Level' 



Kind <f « 
Instruction' 



Ct Ceteqorle.i TIAX - Title I Student., OO/TX - Other-CS Student. In Title I School >» 
OCE/OC?. Student. In Oth.r-C* School., KNCE/** - Non-Ct Stud.nt. Heeding Ct but in School. 

£i°2 noTJJovU. »t72d WCt/CX - Hon-Ct Student. Needing Ct and Attendin g School. ThetJFrovld.Jt 



rot Crade. 1. 3. and 5 



Tot Crade* 2. 4, and 6 



Low 



High 
Average 



Regular 
Special 
Tutor/lnd. 
Total 



Regular 
Special 
Tutor/ Ind. 
Total 

Regular 
Special 
Tutor/lnd. 
Total 



Regular 
Special 

tutor/ ind. 
Total 



192 

90.8 (42) 

50.9 <24> 
7).S <)4) 

21S.I 

686 

It).) (40) 
«9.7 on 
62.4 429) 

28*.* 

444 

126.2 (34) 
1)4.4 (3?) 
10*.? (29) 
)67.8 
2)4 

90.0 (2)) 
200.9 (SI) 
101.9 (26) 
)93.1 







Grade 1 


• 








102 




22 




79 




29S 




94.9 


(49) 


82.1 


(41) 


1 J9. 2 


(SS) 




(58) 


15.8 


(18) 


JO.l 


(IS) 


9.0 


(4) 


111 


(S) 






89,* 


(44) 


97. S 


(41) 


7S.6 


()7) 


19S.6 




202.0 




2)S.7 




204.8 




250 




1S1 




1)7 




S9) 




126.3 


(4)» 


106.$ 


(42) 


187.) 


(61) 


1)8.6 


(47) 


63.4 


(22) 


55.7 


(22) 


26.2 


(9) 


48.9 


(16) 


100.6 


OS) 


89. S 


(36) 


91.4 


O0> 


110.0 


()7> 


290.6 




2S2.1 


O 


)0S.O 




297 6 




98 




* ISO 




70 




219 




146.6 


(41) 


S4.8 


(20) 


161.4 


(42) 


133.4 


()8) 


108.8 


()0> 


1)6.1 


(49) 


98. S 


(2S) 


110. S 


(32) 


101.) 


(28) 


88.1 


()2) 


126.? 


on 


104.2 


00) 


)S7.3 




279.0 




)86.S 




)48.2 




69 




^6 




18 




133 




109. S 


(29) 


70 7 


(18) 


64.4 


(17) 


9S.8 


(2S> 


196.0 


(Sl> 


202.4 


(SI) 


218.4 


(S7) 


19S.0 


(SI) 


77.7 


(20) 


120.6 


on 


101.4 


(26) 


88.8 


(2)) 


)8).2 




)94.4 




£84.2 




379.7 





Regular 
Special 

Tuto»'In4. 
Tot a 



Low 
Avaraga 



High 
Average 



Regular 
Special 

Tutor/lnd. 
Total 



Regular 
Special 

Tutor /ind. 
Total 



Macular 
Special 
Tutor/lnd. 
Total 



187 

79.5 (42) 

47.6 (iS) 
60.2 ()2) 

187. S 

7S0 

99.6 <41) 
72.) ()0> 

69.8 (29) 
241.9 

47) 

111 4 (16) 

111.7 ()6> 

83.1 (27) 
)06.S 
292 

90.9 (26) 
176.3 (SI) 

80.6 <23) 
)48.4 



97 

98.0 (S3) 
19.) (10) 

70.1 ()7> 
187. ) 

2)8 

104.) (42) 
S6.S (2)) 
OS.) OS) 

246. 2 
<>4 

109. S (34) 
110 8 (34) 
104.? 02> 
3.S.4 

49 

48.8 (14) 

203 4 (S9> 

90.? (26) 



9S.6 (SI) 
IS. 6 <*) 
74 1 .40) 
185 9 - 
1S7 

72.1 t»2> 

6« 8 CO) 

8"> 1 »38) 
2 28 i 
1)4 

91 ( (*2) 

iif4.i <4i) 



59 

60 5 d*) 

20'i * 164) 

*>4 7 (17) 



122.2 (62 
11.2 (6) 
64.) ())) 

197 6 

178 
126.2 (S)> 
)).9 <14> 
78.9 ())) 
239.2 
69 

171.6 (46) 
68 S (18) 
1)1 6 OS). 
J71.7 



S8.1 (21) 
199 0 (71) 

24 ) (9) 
281 4 



2se 

109 4 (S6) 
12.9 (7) 
71.2 ()7> 

191.9 
404 

99.1 (41) 
4S.4 (19) 
96.) (40) 
241.2 
IS1 

106. S OS) 

96.1 1)2) 

98 1 ())) 

)00.8 



71 9 (21) 

172.6 (SO) 

98.8 (29) 
343 7 



crad» S 



Low 
Average 



High 
Average 





N 


142 




80 




Aegulir 




88 2 


(57) 


80 2 


<S)) 


Special 




19.8 


(11) 


16 0 


(11) 


Tutor/lnd. 




46.4 


()0) 


54. 8 


(16) 


Total 




154.4 




151.0 






N 


49) 




180 




Regular 




101.) 


(48) 


82 9 


(19) 


Special 




SS.O 


(26) 


5). 8 


(25) 


Tutor/lnd. 




S6.2 


(26) 


77.) 


06) 


Total 




212,6 




214.) 






N 


)72 




97 




Regular 




94.? 


()9) 


79 0 


04) 


Special 




82.? 


()4! 


84 2 


(36) 


Tutor/lnd. 




66. S 


(27) 


69.6 


(30) 


Total 




244.4 




2)).0 






N 


218 




)7 




Regular 




6). 7 


(2)) 


45. 8 


(17) 


Special 




156.9 


(56) 


141.2 


(5)> 


Tutor/lnd. 




58. S 


(21) 


81.1 


OO) 


TOUt 




279.2 




268 4 





)) 




1)4 




428 




114.4 

12.6 
34.1 
161.1 


(71) 
(8) 
(21) 


121.) 
2.9 
)8.6 
162 8 


C4) 

<2) 
(24) 


10) 1 

s.i 

58.2 
166 8 


O) 
OS) 


189 




8) 




57) 




90.0 
40 S 
72.9 
203. S 


(44) 

(20) 
()6) 


101.2 
19.6 
72.8 

193/7 


(S2) 
(10) 
()8) 


104.8 
10 ) 
7). 7 

208.9 


(So> 

(14) 

OS) 


117 




29 




128 




90 8 
78.) 
72.7 
242.0 


OS) 
()2> 
O0> 


89.0 
80.2 
S7.7 
226.9 


()9) 
OS) 
(25) 


86. ) 
77.6 
77.8 
241.8 


()6) 
02> 
(3.) 


46 




20 




58 




72.6 
141.8 

54.2 
268.? 


(27) 

(sn 

(20) 


74.6 
1SS.) 

)02.3 


(25) 
(51) 
(24) 


64.) 
146.1 

65.2 
27S 7 


(2)) 
(5)) 
(24) 



251 
70.4 (40) 
)S.? (20) 
68.) ()9> 
174. S 

748 

124.9 (44) 
74 9 (26) 
82.9 (29) 

282.9 
522 

126.4 <)8> 
119.8 ()6) 
86.2 (26) 
))2.9 
284 

77.2 (20) 
2)7 ? (S?) 

88.) (2*1 
)8) ) c ~ 



90 

100.8 (49) 
2S.2 (12) 
78.1 1)8) 

204.2 

)18 

1)0.2 (48) 

47 9 (18) 

90.7 on 

268,8 

ho 

141 8 (4)) 

109 2 ())) 

81.0 (24) 
))2.6 
45 

79 9 (20) 

221.) (54) 

10S.0 (26) 
406.2 



n*. 

113.8 (S2> 

9.8 (4) 

9) 6 (43) 
217.1 

148 
111 4 (45) 
46 9 (19) 
91.7 <)') 
250 1 

50 

17S 9 (S2> 
7) 8 (22) 
91 3 (27) 
341. S 
6 

34 8 (11) I" S (30) 
1<»S ) <S91 ^ ItS.^ (42) 
100.0 (1)0) US 2 (29) 
))0 4 , )99.S 



15 

78.1 (40) 
26.9 (14) 
88.) (46) 
1)).) 

188 

110 8 ()9) 
60.0 (21) 
109 9 <)9) 
281 0 
169 

64 5 (22) 
121.) (41) 
110.5 ()') 
296. S 
54 



*** 

1) 1.8 <S7) 
i3.7 (6) 
87.0 ')■•) 

2) 2.6 

4*9 >t 
129.0 (46) 
42.) (15) 
109.2 <)9) 
280.7 



198 

100.) (31) 

109.) (31) 

120.1 <36) 
))0. 5 

59 

)9.6 (11) 
21S.S (6T) 

92.2 (27) 
347.7 



201 

87 6 (47) 

35.7 (19) 
62.0 ())) 

185.6 

449 

89.8 (40) 
64 7 (29) 
69.8 (31) 

224.6 

412 

100.1 (38) 
96 3 ()6) 
69 0 (26) 

26S 9 

256 

85 0 (27) 
162 6 (52) 

64 7 (21) 
)12 8 







Grade 4 






66 




65 


\ 


179 




86.5 
14.5 
72 2 
17).) 


(SO) 
It) 
(42) 


84. ) 
26 4 
6) 7 
174 S 


<4*h 

(15) 
()6> 


1)2.1 
3.6 
45.0 
180.7 


(7)) 
(2) 
(25) 


179 




210 




116 




88.2 
4b. 7 
7). ) 

208 ' 


(42) 

(22) 
OS) 


86. 1 
50.1 
8* 9 
22). ) 


()9> 
(22) 
<)9) 


112 4 

>J.4 
61 
.'08 1 


(54) 

(16) 
O0> 


111 




9fc 




)5 




77 6 
101 ) 

65 0 
244.2 


()2) 
(42) 

(27) 


75 5 
9) 2 
8) 8 
252 6 


00) 

()?) 
on 


6«.l (29) 
89 0 (18) 
7'A (1)) 

2)4. H 


54 




31 




10 





58 6 (21) 

ISO 4 (54) 

70 6 (25) 
279 1 



29.) (12) 
174 7 (71) 



27.1 <12) 

191.8 <82) 

15 6 O 
2)4 6 



447 

97.4 (S5) 
8.8 (5) 

69.4 (40) 
175.7 

185 

99. 5 (46) 
)A.2 (18) 
77.5 (16) 

215. ) 

is: 
104 s r» 

90.1 (341 
70.7 (2?) 
26S S 

it 

104.) (34) 
144 0 (47) 
56 O (18) 
)04 4 



R6 



70 5 (V») 
14.6 00) 
55 6 (19) 
140 9 
4)2 

93.3 (47) 
47 2 (24) 
S9 2 (30) 

199 8 
)0 

90.4 (16) 
90.8 (l'> 

67.2 (27) 
248.? 

2)5 

68.3 (25) 
14S.0 (S3) 

S8.3 (21) 
271.7 



148 

93 3 (69) 

8 7 «) 

)) 8 (25) 
1 )5.B 



259 
94 ) (SI) 
)9 S (22) 
49.2 (27) 
181.0 
97 

8) 9 ())) 
101.) (19) 

71.1 (28) 
256.4 

)5 

91.4 (in 
148 9 (49) 

S8.9 (20) 
)01 4 



41 




It) 




76 9 


(441 


104 8 


(68) 


2'"> 4 


(in 


) 1 


m 


60 0 


( )H> 


45.9 


Ooi 


15' 7 




15) « 




185 




1)1 




7fc I 


(19) 


116 S 


(57) 


W.l 


(20) 


22.6 


(in 


78.6 


(41) 


64.0 


()2> 


19) 9 




201.2 




95 




24 




79 ) 


OS) 


74.4 


(14) 


90.4 


(40) 


7A 8 


(H> 


S6 7 


(25) 


6S ) 


()0> 


227 0 




218.7 




10 




)) 




56.0 


(2)) 


)9.8 


(13) 


140 7 


(58) 


146.2 


(49) 


46 9 


(19) 


S).2 


(18) 


243.7 




299.) 





JJ81 

96 ) (t.4) 

8 1 (5) 
45 0 ()0> 
149 S 

6*1 
8A.6 (47) 
29.3 (1C) 
70.6 (37) 
188.6 
148 

S3. 9 (26) 
88 0 (43) 
64 5 (11) 
206 5 
77 

75.0 (30) 
1)9 6 (5*) 

18 6 (15) 
251.5 



*The four coat level* 
kind, of lnetructlon 



vtrt obt*li«ed 
vara obtained 



by collapsing tne eigni iav»ia 'IT . J 

by eo»bining the fir.t three, ne»t four, and the last 



ao that every two adjacent leval. for* a new 
three ln.tructlonal aattlng. fhovn In Table 



The three 



377 



402 



MaiAa 4*4 Corraapondfng T>«rc«nta?*« (in faranthaaia) of Standard *teaourca-Doll*r Cotta for teading *arvlc«a tecaivad 1* Thro* 
Kind* of Instruction (tegsiUr. Spacial. and Tutor/lndap«nd«nt>. by Ct Catagoriat and row Uvol* of tho Total Coata for tending at Uch cr*U 



Coat 



Low 
Avara9a 



t Mgh 
Avarag* 



Low 
Av«ra<?a 



Av»r*7* 



Kind of 
In at ruction* 



tegjlar 

Tutor/lnd. 
ToWl 



tegular 
Spacial 
Tutor/ Xrvd. 
Total 



tegular 
Spacial 
Tutor/lnd. 
Total 



tegular 
Spacial 
Tutor/1 ivl. 
Total 



tegular 
SpacUl ' 
Tutor/Irwi. 
Total 



tegular 
SpaClal 
Tutor/lnd. 
Total 



tegular 
Special 
Tutor/lnd. 
Total' 



tegular 
Spacial 
Tutor/lnd. 
Total 



CE Catvgoriasi T1A1 - Titl« X Stodantti OOE/TI • Othar-CE Studanta in Titla X School as 
OCE/OCK • Othar-CE Studanta in Othar-OC School* j MNCE/NC1C • Won-CE Studtnta Haadlng CE but in Schoola 
That do not Provida itl and NNCE/CE • Non-CE Studanta Haadlng CE aM Attandlnq School a That frovida lit 



ror Cradaa 1. ). *M 5 



19: 

89.) (4 7) 

65 6 ()4> 

)6.5 Q9) 
191.0 

686 

126 2 ()8) 

164. 5 (SO) 
40.9 (12) 

)29.9 

444 

149.6 (29) 
)06.4 -(60) 

5). 5 (11) 

so7.e 

2)4 

95.9 (1)) 

617.2 (81) 

SO. 9 (7) 
76) 1 



102 

99.9 (52) 
6). 4 ())) 
)0.9 (16) 
19). 5 

250 

1)0.0 (40) 
147.6 (45) 
46.4 (15) 
)25.7 



155.5 ()2) 

288 0 (58) 

50.1 (10) 
492.6 

69 

128.8 (17) 

604.) (78) 

)9.4 (5) 
772 4 



22 

88.7 (46) 
52.) (27) 
51.9 (27) 
19). 0 

151 

1)0.4 (42) 

1)5.4 (4)) 

48.) (15) 
)12.6 

110 

62.4 (12) 

m.O (79) 

45.7 (9) 
502.5 

56 

80.9 (10) 
667.9 (8)) 

56.8 (7) 
804.8 



79 



29* 



110.) (64) 126.9 U4> 

22.7 (1)> 25.2 (1), 

)8.4 (21) )5.9 (19) 

178.9 186.7 



1)7 



59) 



188.0 (6)) 14). 6 (45) 

68.8 (2>) 120.1 (>8) 

42.5 (14' 5). 8 (17) 

299.) 



70 



219 



156.6 (>2> 141.2 (28) 

274.2 (564 Jl).4 (62) 

55.6 (11) 51.7 (10) 

485.5 505.7 



for Cradaa 2. 4, and 6 



18 

51.6 (7) 
682.8 (87) 

48.7 (6) 
782.9 



1))! 

89.5 (12) 

607.0 (82) 

40.9 (6) 
7)7.4 



Crada ) 



187 




97 


1 


62 




68 




75 4 


(47) 


98.5 


(62) 


84.9 


(54) 


112.6 


(70) 


S7 9 


()6) 


28 1 


(18) 


)1.1 


(20) 


16.7 


(10) 


28.1 


(17) 


>>.! 


(21) 


)9.) 


(25) 


)1.0 


(19) 


161 1 




159.5 




156.5 




159.9 




750 




2)6 




157 




178 




10«. 9 


<)7) 


128 9 


(4)) 


6>.l 


(29) 


142.0 


(49) 


147.2 


(51) 


128.8 


(4)) 


155.6 


(55) 


107.8 


()7) 


)5.9 


(12) 


4). 6 


(15) 


44.6 


(16) 


>9.7 


(14) 


289.1 




>00.0 




262.5 




268.) 




47) 




94 




1)4 




69 




129 1 


(28) 


126 9 


(28) 


87.1 


(19f 


195.9 


(44) 


289.8 


(6)) 


275.9 


(61) 


142.4 


(7)) 


190.6 


(4)) 


45.9 


(10) 


52.5 


(12) 


40.4 


(9) 


61.1 


(14) 


46). 5 




454.5 




469.) 




445.4 





292 

99 5 (14) 
547.4 (79) 
4). 9 (6) 

<70 2 



49 

56.1 (8) 
615.2 (86) 

41.6 (6) 
714,6 



59 

61.5 (8) 
658.9 (67) 
>2.6 (4) 

75). 1 



69.2 (10) 

628.2 (69) 

11.6 (2) 
706.5 



258 

101.6 (65) 
20.5 (1>> 
>4.5 (22) 

156.4 

404 

111.) (>9) 

12).S (4)) 

50.9 (16) 
264.8 

151 

106.0 (24) 

290.9 (65) 

51.5 (11) 
449.6 

89 

75.4 (11) 
577.9 (62) 

50.4 (7) 
70). 5 



Low 
Avaraga 



High 
A vara go 



tegular 
spacial 
Tutor/lnd. 
Total 



tegular 
Special 

Tutor/lnd. 
Total 



tegular 
Special 
Tutor/lnd. 
Total 



tegular " 
Spacial 
Tutor/lrtd. 
Total 



142 
68 8 (60) 
22 9 (20) 
22.4 (20) 
114.4 

49) 

98.2 (41) 
111 0 (47) 

29.6 (12) 
2)8.5 

)72 

110.7 (29) 

2)1.0 (61) 

>9.7 <*0) 
>80.) 

218 

71.1 (12) 

504.) (82) 

>5.4 (6) 
612.6 



80 

71.4 (56) 
25 2 (20) 
11.1 (24) 
126.2 

16? 

94.0 (41) 

94. 1 (41) 

41.6 (16) 
2)0.0 

97 

96.7 (25) 
256.1 (65) 

>6.4 (10) 
>91.6 
)7 

56.6 (10) 
48). 1 (8>) 

42.4 (7) 
561.7 



Gr*d« 5 
>> 

91.9 (75) 
15.9 (1» 
14.5 (12) 
122.4 

189 

108.8 (45) 

92.4 (>8) 

42.1 (17) 
241.) 

117 

111.8 (29) 

228.) (60) 

42.5 (11) 
>80.) 

46 

70.2 (12) 
470.4 (8>> 

>0.2 (5) 
570.2 



1)4 

102.4 (80) 
6.5 (5) 

19.4 (15) 
128.6 

8) 

111.7 (52) 
59.9 (26) 
45.1 (21) 

217.9 

29 

91.4 (25) 

249.5 (67) 
28.8 (6) 

)69.7 

20 

9). 7 (15) 
489.0 (79) 

)9.7 (6) 
621.4 



428 

64.9 (70) 
8.5 (7) 

26.7 (24) 
122.0 
57) 

112.5 (50) 
76.9 ()4> 
)6.0 (17) 

227.0 

126 

100.8 (27) 

2)1.2 (61) 

45.5 (12) 
)76.6 

56 

7). 5 (12) 

481.6 (60) 
44.4 (7) 

599.0 



251 

74.7 (47) 

47.) (>0> 

>7.6 (24) 
159.) 

746 
140.1 (44) 
14). 6 (4>) 
42.) (1>) 
))0.7 

522 

144.9 (29) 
114.4 (62) 

45.7 (9) 
50). 6 

284 



90 

97.) (5>) 
4). 6 (24) 
4). 6 (24) 
16). 5 

119 

154.4 (50) 
106 2 (>5) 
47.4 (15) 
^08.! 
1)0 

158.4 (11) 

109.8 (61) 

41.6 (8) 
508.6 



Crada 2 

15 

80.9 (42) 
65.5 (>4) 
45.) (24) 
191.2 

188 

124.8 ()8) 
151.1 (46) 
55.2 (17) 
))0.0 
169 

78.5 (16) 

)56.2 (7>) 

57.0 (12) 
491.1 



116 
112.6 (64) 
17.4 (10) 
45.4 (26) 
175.9 
148 

1)2.4 (42) 
1)6.5 (44) 
45.0 (14) 
111.4 

50 

219.1 (45) 
221.9 (44) 
45.9 (9) 
, 464.6 



2)4 

112.6 (6)) 
26.7 (16) 
J8.0 (22) 

179.) 
459 

14).* (47) 
109.1 ()6) 
55.4 (1») 
)07.2 

191 

125.4 («) 
)2).4 (64) 
60.9 (12) 
506.6 



150.5 
449 



29).) 
412 



4)7.0 

256 



224.9 
)7) 



)67.1 
2)5 





45 




54 




6 




59 




(1)) 


66.8 


(10) 


17.2 


(5) 


122.7 


(17) 


40.9 


(5) 


(81 ) 


715.7 


(84) 


667.1 


(68) 


5)).) 


(75) 


66). 0 


(89) 


(6) 


51.) 


(C) 


55.4 


(7) 


58.) 


(8) 


47.0 


(6) 




855.4 




760.0 




71).) 




770.6 










Crada 


4 












66 




65 




179 




447 




(47) 


61.4 


(56) 


65.6 


(5)) 


108.6 


(76) 


9). 4 




())) 


22 8 


(16) 


41.8 


(26) 


11.1 


(8) 




(12) 


(20) 


42.6 


(29) 




(21) 




(16) 


)4.6 


(24) 




146.4 




160.6 




14). 7 




145.8 






179 




210 




116 




)65 




OS) 


112.6 


(4)) 


106.4 


()9) 


117.) 


(45) 


116.2 


(45) 


(5)) 


114.0 


(4)) 


121.0 


(44) 


108.) 


(42) 


105.5 


(40) 


(1 )) 










)2.4 


(1 )> 


41.5 


(16) 




264.) 




275.6 




257.9 




264.0 






Ill 




96 




)5 




152 




(27) 


10). 8 


(24) 


86.5 


(20) 


7).0 


(16) 


110.6 


(24) 


(64) 


296.0 


(68) 


266.6 


(68) 


296.1 


(72) 


272.6 


(64) 


(9) 


)4.9 


(8) 


47.9 


(11) 


41.2 


(10) 


41.4 


(10) 




4)). 7 




422.5 




410.2 




424.0 






54 




11 




10 




62 




(14) 


72.2 


(12) 


)7.5 


(6) 


IS.) 


(5) 


119.) 


(19) 


(80) 


494.6 


(82) 


606.1 


(91) 


647.6 


(94) 


477.) 


(75) 


(6) 


17.1 


(6) 


22.6 


()) 


9.6 


(1) 


It.l 


(6) 




60). 4 




665.9 




692.5 




6)). 4 










Crada 


6 












146 




41 




16) 




481 




(60) 


6). 6 


<6«) 


60.0 


(5)) 


70.7 


(7)) 


71.1 


(64) 


(IS) 


17.) 


(16) 


)0w0 


(27) 


4.6 


(5) 


14:2 


(1)) 


(25) 


15.4 


(16) 


22.7 


(20) 


21.1 


(22) 


21.4 


(20) 




96.2 




112.5 




97.1 




106.9 






259 




165 




1)1 




641 




(4)) 


91.0 


(44) 


68.2 


(»: 


110.7 


(52) 


9). 6 


(44) 


(4)) 


69.0 


(4)) 


94.1 


(41) 


65.2 


Oil 


71.2 


OS) 


(14) 


26.9 


(1)) 


46.5 


(20) 


1S.1 


(>7) 


96.4 


(19) 




207.2 




227.2 




211.2 




202.8 






97 




95 




24 




148 




(27) 


76.6 


(22) 


75.2 


(20) 


79.) 


(22) 


61.2 


(17) 


(6)) 


241.6 


(66) 


266.4 


(71) 


245.4 


(69) 


266.1 


(7)) 


(10) 


16.1 


(10) 


)).0 


(9) 


12.1 


(9) 


* )6.5 


(10) 




)54.8 




174.4 




157.1 




)6).9 






)5 




)0 




)) 




77 




(14) 


111.0 


(19) 


56.4 


(10) 


125.5 


(20) 


77.9 


(14) 


i (61) 


452.9 


(76) 


460.2 


(65) 


478.6 


(76) 


472.8 


(•)) 


(6) 


11.1 


(5) 


25.) 


(5) 


24.7 


(5) 


21.} 


(4) 


) 


594.6 




541.6 




6)2.7 




571.7 





*Tha four coat lavala vara obtalnad by collapaing tha aight lavala axplainad 
'klnda of in at ruction var* obtainad by co*btning tha firat thrao. na*t four. 



in Tabla 0-4 
and tha laat 



ao that a vary two adjacant lavala foia « *»" Uvl. Tha thra* 
thra* lnatruetional tat-in?* •hen in Tabla 0*4. 
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Tably D-10 7 [ 

Mean, and CDfrt.pondlrvg Nrcentege. (In Parenthesis) of Yearly Hours of K*th Service. Received In Three tflnd. of In. traction 
^!.^sScr.tr^^tor/i^t?Lw). by cr at^., *nd Four Uveis «f tu Total C».t. for Hath Service, at tesh cr.de 



OMt 



Kind of 
Instruction* 



Ct Categories, Tl/Tl ' Title 1 Student.i OCT/TJ - Cther-CT Student. In Title ^ Sctwol.. 
OCT/OC?- WnS-Ct itudent. In Other-Ct School., NNCt/W* - Student. Need l«CI but inj 



S( * "JTrovide mend WcSS - *>»-« Student. MM CZ end Attending Schools^ Provide It 



for Cr.de. 1. J. * 



tow 
Average 



Blgh 
Averse 



Regular 
Special 
Tutor/lnd. 
Total 



ftegular 
Special 
Tutor/lnd. 
Total 



Regular 
Special 

Tutor/lnd. 
Total 



Regular 
Speelal 

Tutor/lnd. 
Total 



Avenge 



Average 



Regular 
Special 
Tutor/lnd. 
Total 



Hegul.r 
Specie! 
Tutor/lnd. 
Total 



Ragular 
Speclel 
Tutor/ ind. 
Total 



Regular 
Special 

Tutor/lnd. 
Total 



bow 
Average 



Nigh 
Average 



Regular 
Special 
Tutor /Ind. 

TO til 



Regular 

Spaclal 
Tut >r/lnd. 
Total . 



Regular 
Special 
Tutor/ Ind. 
Total 



Regular 
Special 
Tutor/lnd. 
Total 



45. J (45) 
18.4 (IS) 
J7.4 (J') 



60.7 (54) 
Id. 1 (9) 
41.2 (J7» 



n.2 oo) 

25.2 (24) 
46.? (45) 



10) 

78 4 (62) 

1.? (1) 
47.2 <J7) 



101.0 




111.9 




10 J. 0 




12'. 4 




J56 




218 




95 




J5J 




70.5 
J5.0 
47.6 
15). 1 


(46) 
(2)) 

on 


74.7 
19.9 
51.2 
145.8 


(51) 
(14) 
<J5) 


80.8 
35.4 
54.9 
161.0 


(50) 
(16) 
(J4) 


104.5 

1J.0 
58.9 
176.5 


(59) 
(7) 
OJ) 


255 




61 




8) 




109 




85.4 
58.) 
42.7 
186. S 


(46) 

on 

(2)) 


71.7 
4?. 9 
J7.0 
158.6 


(45) 
(Jt) 
(2)) 


55.5 
50.5 
5). 9 
160.0 


(J5) 
(J2) 
(J4) 


69. J 
51.9 

57.9 
179.2 


(J9) 
(29) 
()2) 


119 




16 




24 




26 




55.8 
114.2 

45.2 
21S.4 


(26) 
<5D 
(21) 


27.6 
97.2 
41.1 
165.9 


(17) 
(59) 
(25) 


42. 7 

8?.I1 
9C76 
201 4 


(21) 
(41) 
()8) 


56.0 
116.2 

92.) 
264 7 


(21) 
(44) 
(15) 










Grade J 






77 




69 




20 




250 




66.5 
17.4 
65.2 
149.1 


(45) ^ 

(12) 

(44) 


8o J 
8.0 
71.) 
159.6 


(50) 
(5) 
(45) 


105.9 
4.9 
46.1 
157.1 


(67) 
(J) 
(29) 


88. J 
1.8 
54.1 
144.2 


(61) 
(1) 
<)8) 


J9B 




201 




152 




241 




78.5 
)9.) 
54.4 
172.2 


(46) 
(2)) 
02> 


ee.: 

26.8 
5), J 
168.4 


(52) 
(16) 
(J2> 


77.4 
24.0 
77.1 
178.5 


(4 J) 
(1J) 
(4J) 


91 6 
12. J 
65.9 
17'. 8 


(56) 
(7) 
(J7) 


281 




85 




45 




97 




80.2 
59.4 
50.9 
190.' 


(42} 
(Jit 
(27) 


72.6 
57.8 
66.8 
197. J 


<)7> 
<29> 
()4) 


71 5 
56 8 
68.0 
196.2 


()6) 
(29) 
<J5> 


116.4 
J) 5 
81.2 

2J1.2 


(50) 
(14) 
(J5) 


164 




JO 




JJ 




27 




79.7 
108.7 

4).0 
2)1.4 


()4) 
(47> 
(19) 


70.4 
104.8 
4J 9 

219.2 


(J2I 
(48) 

(20) 


79.4 
11). 6 

71.4 
264.5 


(JO) 
(4J) 
(27) 


1JJ.1 
61 7 
JJ.O 

227 8 


(58) 
(27) 
(14) 



202 

76.4 (64) 

1.8 (2) 

42.0 (15) 
120.2 

520 

8). 4 (54) 
12.2 (8) 

59.1 (J8) 
154.7 

164 

79.0 (46) 

42 4 (24) 

52.0 (JO) 
17J.5 

80 

70. J (JJ) 

84.2 (40) 
57.2 (27) 

211 8 



/-de. 2. 4. and 6 



J02 

82.6 (60) 
5 5 (4) 

50.7 (J6) 
1J8.8 

JJ6 

92.9 (5J) 

18.7 (11) 
<? 2 (J6» 

17J.9 

12: 

75 2 (40) 

55.5 (29) 

58.6 <)1) 
189.5 

58 

46.8 (2J> 
105.7 (5J> 

47.6 (24) 
200.2 



58 

96.2 (78) 

6.7 (5) 
21.0 (17) 
12). 9 
11) 

95.8 (5)) 

42.5 (2J) 

4 J. J (24) 
181.7 

204 

80.7 ()9) 

74.8 ()6) 
5). 4 (26) 

209.0 
141 

96.5 ()6) 

DJ.4 (49) 

J9.8 (15) 
269.6 



49 

1J2.2 (8J) 
1 9 (1) 

24.8 (16) 
158.9 

179 

87.4 (52) 
27.1 (16) 
5J.0 (J2) 
167.5 

102 

66.9 ()2) 
55.4 (26) 
89.1 (42) 

ill. 6 

20 

JS.J (19) 
1JJ.1 (66) 

JO. 7 (15) 
202.1 



16 

118.4 (82) 
9.9 (7) 

17.0 (12) 
145.) 

164 

75. ft (44) 

28 7 (17) 

67.1 ()9) 
171.6 

52 

54.2 OO) 

70.4 ()9) 

55.5 Ol) 
180.1 

14 

22.0 (11) 
1)6.1 (68) 

42.) (21) 
200.4 



207 
117.0 (78) 

0.6 (0) 
)).) (22) 
150 9 



J9I 

102 9 (6J> 
14.6 (9) 
45.6 (28) 

16).) 
88 

40 2 (22) 
64.1 06) 
74 4 (42) 
178.8 
J7 



27) 
99.9 (67) 

2.9 (2) 
45.2 OI> 
148.1 

. 50) 

106.5 (59) 

19.4 (11) 
54.8 00) 

180 7 

121 

65.) 05> 
64.2 04) 

56.5 OO) 
186.5 

J9 



J4.2 (17) 86.5 Ol) 

127.5 .(62) 1JJ.2 (41) 

4J.9 (21) 57. J (21) 

205.7 »7.9 



64 

W.J ()2) 
5.2 (5) 
68.4 (6)) 
109.0 
429 

85.1 i 2) 
22. * (14) 
55.9 04) 
16). 9 
244 

81.4 (41) 
5). 2 (28) 

56.5 00) 
191.2 

165 

69.5 00) 
100.6 (44) 

60.6 (26) 
2)0.9 



48.2 (46) 
105.2 
265 

67.6 (44) 
17 6 (11) 
68.2 (44) 
15). 4 

10* 

74.0 (40) 
56.5 Ol) 
52.) (29) 
182.8 
24 

)2.0 (15) 
104.6 (50) 

74.5 ()5) 
211.1 



)4.4 (45) 

1.4 (2) 
40.1 (5)) 
75.9 
70 

9). 4 (52) 
16.0 (9) 
70*5 ()9) 
179.9 
6J 

44.9 (27) 
6) 5 08K 

59.7 (J5) 
168.1 

26 

24.8 (1)) 
106.8 (59) 

5).) (29) 
184.9 



4T.4 (42) 
11). 2 t 

J70 
110.7 (67) 

7.0 (4) 
48.6 (29) 
166.) 

70 

8). 8 (46) 
40.4 (22) 
59.6 02) 
18). 7 

21 

45.2 (22) 
94.2 (46) 
66.4 02) 
206.) 



68 

69.0 (62) 
1.9 (2) 

41.1 on 

112.1 
J91 
87.0 (54) 
11.9 (7) 
62.6 ()9) 

161.5 

180 

104.5 (51) 
)6.8 (18) 
64.6 Ol) 

206.0 

12) 

11). 2 (42) 

78.4 (29) 

76.2 (28) 
267.6 



58 

66.1 (48) 

12.5 (9) 
59.1 (4)) 

1)7.7 

»v 

85 9 (49) 
)6.) (21) 
52. TB 00) 
175.1 
176 

106 0 (4P) 

6) .l 129) 
V>.1 (2)) 

219 2 

122 

7) 7 (28) 
129 ft (49) 

61.6 (2)) 
265 4 



49 

8).l (5)) 
1.8 (1) 
72.4 (46) 
157. J 

197 

91.6 (52) 
20.9 (12) 
62.) ()6l 
174.8 
107 

«8 7 09) 

47 7 (21) 

90. * '40J 
227.) 

42 

64 8 (26) 
1)0 5 (52) 

5) 5 (21) 
2AV 2 



Grade 4 



147.4 
171 



212 ) 
Crade 6 



(67) 


108.9 


(70) 


O) 


0.4 


(0) 


O0> 


46.) 


OO) 




155.6 






497 




(4)) 


104.8 


(62) 


(16) 


11.2 


(7) 


(41) 


52.0 


on 




16*1.0 






)7 




<)?> 


81 6 


()9) 


(26) 


(>6.5 


on 


(41) 


6). 2 


O0) 




211.) 






14 




(27) 


?6 8 


on 


<5)) 


111.0 




(19) 


60.9 


(24) 




248.0 





22) 

98.2 (68) 
2.) (2) 

44.8 Ol) 
145.) 

440 

98.2 (57) 

18.9 (11) 
55.7 ()2) 

172.8 
107 

84.7 (41) 

69.5 04) 

52.0 (25) 
206.2 
51 

25.0 (1J) 

1,6.0 (69) 

)4.9 (18) 
196.1 



56 

4) 8 (81) 

4.0 O) 
18 2 <lt>) 
116.1 
275 

8) 6 (51) 

JJ.O (20) 

48.0 (29) 
164.7 

156 

66.0 04) 
76.7 (40) 

~48 6 (25) 

191.8 

155 

101.9 (41) 

12O.0 (47) 

10.7 (12) 
254.7 



SJ 1 (60) 

) 1 (2) 
51.) 07) 
1)7 5 
JA0 

75.0 (49) 
2) 0 (15) 
55.4 ()6) 
151.4 
77 

19 7 (22) 
70 J (J9) 
69.) ()9) 
179.9 

16 

51.) (26) 
116.0 (58) 

J2.1 (16) 
199 4 



99 7 (79) 

).0 (2) 
24.2 (19) 
127.0 

144 

71 9 (41) 
11.6 (18) 
70 0 (40) 
171.6 
82 

75 ) |4l) 
52.9 (29) 
55.1 00) 
18) 6 

14 

)5.6 (21) 
105.) (61) 

11.4 (18) 
172.) 



65 

90.7 (66) 
0 5 (0) 
46.4 ()4) 
1)7.6 
477 

114.9 (69) 

11.7 (7) 

J8.8 (2)) 

165.4 

14) 

84.2 (44) 

52.7 (28) 

5) 6 (28) 
190.4 
54 

125.0 (49) 

95 J <J7) 

)4.2 (D) 

254.6 



222 

89.) (68) 
1.7 (1) 

40 4 Ol) 
1)1 4 
671 . 

104.1 (6)) 
12.4 (8) 
4ft. 4 (29) 

165.0 
129 
91.0 (51) 
50.2 (28) 
H.9 (21) 
178.1 
)9 

56.2 (29) 

102.2 (52) 
J7.4 (19) 

195.8 



*The four coet level, 
kind, of instruction 



were obtained 
were obtained 



by collapsing the eight level, explained In Table 0-« 
by combining the first three, next four, and the last 



so that every two adjacent • ^T" 1 * 

three Instructional settings shown In Table £>-6 



404' 



ERIC 



379 



Means *M Correapondlne Percentages lift l*ar*nthes**> of Standard. *e*ourc*-Ooyar Coats for Ketfc Services Aecelved In Three Kind, of 
li.'ructlon (*Jv»i«. Special. *nd Tutor/Independent), by Ct Cate^orUs *nd four Uvel* of the Total Cost, for Math •ttjCh^CMd* 



Cost 
Level* 



Kind of 
Instruction* 



Ct Categories i TI/TI • Title I Student* i OCt/TI - Other-CE Students In TltU X School*; 
OCIVOCt " Other C£- Student a In Other-CE School • J MX/tKt - Non-CX Students Heeding CT but In School* 
that do not Provide Iti and MCZ/CE • Non<t Studeits Needing CT and Attending School* That Provide It 



for Crade* 1. ). er«d 5 



for Crade* 2. 4. and 4 



n»7ui*f 

Special 

Tutor/Ind. 

Total 



Nigh 
Average 



Aeguler 
Special 
Tutor/Ind. 

Total 



Regular 
Special 
Tutor/Ind. 
Total 



Ae<7Ml»r 
Spec 1*1 
Tutor/Ind. 
Total 



C6.8 
156 



I) 9.6 
255 

(40) 

II) 1 (SO) 
21.6 (10) 

6.3 
119 

61. V U6> 

5.2 If) 

2) 8 (6) 
190 * 



Regular 
Special 

Tutor/ 1 iv). 
Total 



Regular 
Special 



Average Tutor/Ind. 
Total 



nebular 
Special 
TUtor/lnd. 
Total 



Regular 
SP«clal 
Tutor/Ind. 
Total 



Low 
Avera'H 



Hl9h 
Average 



Regular 
Spec! el 
Tutor/Ind 
Total 



Regular 
Special 
TUtor/lnd. 
Total 



Regular 
Special 
TUtor/lnd. 
Total 



Regular 
Special 
Tutor/Ind. 
Total 





111 




8 




10} 




(4:> 


)*.5 


(52) 


17.6 


(24) 


47, * 


(67) 


OS) 


1).0 


(19) 


)< 7 


(46) 


1.0 


()) 


(2)) 


19.5 


(29) 


20 9 


(28) 


21.6 


()0) 




68.0 




74.5 




71.1 






210 




95 




)5) 




(45) 


68.6 


(51) 


59.7 


(4)) 


74.1 


(59) 


()9) 


)9 4 


(29) 


51.2 


()7) 


24 ) 


(19) 


(1-) 


27 0 


(20) 


26.4 


(19) 


26.7 


(21) 




1)5.0 




1)7.) 




125.1 






6 

61 




6) 




109 





72 1 ())) 

129.9 (59) 

16 5 («) 
220.5 
16 

25.1 (') 
)20 9 (66) 

20.2 (6) 
)66 2 



66.9 (29) 

126.9 (56) 

)2.) (14) 
228.2 

24 

49.0 (1)) 
27). 9 (74) 

•o 2 (12) 
)68 1 



58 6 (27) 

1)0.6 (61) 

26.6 (12) 
215.9 

26 

42.6 (11) 
)16.2 (SO) 

)5.4 (9) 
)94 ) 



202 




64 




62 




' 








47 4 


(65) 


2). 2 


()7> 


)6.5 


(56) 


)7.0 


(59) 


)6.6 


(62) 


5.2 


(7) 


9.2 


(15) 


5.0 


(6) 


4.6 


(7) 






20.1 


(28) 


30.8 


(49) 


24.1 


()7> 


20.9 


())) 


20.4 


())) 


72.7 




6). 2 




65.6 




62.5 




62.1 




520 




429 




265 




?0 




)70 




69 0 


(54) 


69.0 


(5)) 


61 7 


(V» 


66.1 


<51) 


62.8 


(67) 


)0.4 


(24) 


)) 0 


(25) 


29.6 


(24) 


)0.7 


(2)> 


17.0 


(14) 


26.4 


(22) 


27.7 


t:i) 


)4.0 


(17) 


)4.7 


(26) 


22.9 


(19) 


127.8 




129.7 




125.4 




13). 5 




122.8 




164 




244 




106 




67 




70 




74.5 


())) 


80.9 


()5> 


77.8 


()6> 


5). 8 


(23) 


84.3 


<)7> 


124.9 


(56) 


121.5 


(5)) 


111.8 


(52) 


149.) 


(64) 


11). 9 


(51) 


24.5 


(11) 


28.4 


(12) 


27.2 


(1)> 


)0.2 


(1)> 


26.7 


(12) 


22). 9 




2)0.* 




216.8 




2)).) 




224.9 




80 




165 




24 




26 




21 




75.7 


(22) 


68.1 


(16) 


)2.4 


(6) 


20.5 


(6) 


4). 6 


(12) 


246.5 


(71) 


267.8 


(7i> 


328 .1 


(6)> 


292.5 


(66) 


)O4.0 


(80) 


24.9 


(7) 


27.8 


(7) 


)7.0 


(9) 


26.2 


(6) 


?1.1 


(!) 


)47 1 


)8) 7 




)97 4 




)J9 J 




)78.7 





Crade ) 



n 

l 1 147) 
20 6 (21) 
JO 6 ()2) 
36.4 

H8 
6) 8 (19) 
">) > (45> 
26.* (16) 
164.4 

281 

1 6 ()2> 
141 6 (57) 
25.9 (10) 
51.2 

164 

'2 2 (18) 
U2.) («) 
22. 5 (6) 

107 0 



69 




20 




250 




)o: 




54.2 


(57) 


68.0 


<70) 


55.6 


(65) 


5).) 


(6)) 


11 0 


(12) 


• 8 


(9) 


4.8 


(6) 


9.1 


(in 


)0.1 


02) 


JO. 4 


(21) 


24 7 


<29) 


22.0 


(26) 


95 2 




97.2 




85.1 




64.4 




2 A 1 




152 




241 




))6 




71 8 


(47) 


61 5 


(41) 


61 6 


(54) 


79.9 


(5)) 


57.8 


()7) 


51 7 


()4> 


)7.6 


(25) 


4) 0 


(28) 


24.8 


(16) 


16.7 


(24) 


)2.0 


(21) 


29.0 


(19) 


154.5 




150.0 




151.2 




151 9 




0> 




45 




97 




122 




70 1 


(20) 


59.9 


(2)) 


115.2 


(45) 


71.0 


(27) 


150 3 


(60) 


160.9 


(6)) 


10-. 5 


(40) 


159.8 


(62) 


)2.1 


(1)) 


)4 1 


(1)) 


)7.4 


(15) 


28.7 


(11) 


*S) 1 




254.8 




255.1 




259.6 




)0 




)) 




27 




58 




64 C 


(15) 


62.1 


(16) 


151.9 


(41) 


45 7 


(11) 


)45.4 


(00) 


295.8 


(75) 


205.6 


(55) 


)46.9 


(8)) 


24.9 


<*> 


)4.8 


(9) 


16.7 


(4) 


2>.5 


(6) 


4)4 1 




)92 7 




)74 ) 




416 1 





58 

51.5 ('9> 
5 * (9) 
7.9 (12) 

65 0 

)1) 

76.8 (47) 
65.7 (40) 
21.5 (1)) 

164.0 
204 

'4.6 (25) 
91.1 (65) 
2ft.) (10) 
(94.0 

141 

90.9 (18) 
)90.8 (78) 



49 

6) 5 (8>) 
).2 (4) 
9.6 ())> 

76.) 

179 

76.5 (46) 
62.8 f>8> 
25.8 (16) 
165 2 

102 
77 4 (28) 
158.2 (57) 

42.0 (15) 
277.7 

20 

)8 9 (6) 
4)2.9 (89) 

14.1 ()) 
415 9 



66 

44.1 (66) 
).2 *S) 

19.2 (29) 
66.6 

)91 

66.7 (55) 
25.0 (21) 
29.9 (25) 
121.7 

160 

91.9 (40) 
104.) (46) 

)1.) (14) 
227.5 

12) 

115.9 (30) 
240.9 (62) 
)2.1 (8) 

100.0 



16 




207 




27) 




56 




69.1 


(79) 


69.) 


(61) 


59.4 


(72) 


54 1 


(85) 


11 0 


(1)) 


1.9 


(2) 


4.1 


(5) 


1.4 


(5) 


6.0 


(8) 


14.5 


(17) 


16.9 


(2)> 


6.1 


(10) 


86.9 




85.7 




• 2.4 




6). 7 




164 




)91 




50) 




275 




74.2 


(44) 


8). 2 


(60) 


8).6 


(57) 


66.0 


(48) 


50 ) 


OS) 


)5.) 


(25) 


)8.2 


(26) 


52.1 


OM 


)5.9 


(21) 


21.1 


(U» 


25.) 


(17) 


2).0 


(16) 


166.4 




1)9 6 




147.2 




141.2 




52 




68 




121 




156 




49.) 


(17) 


41.2 


(14) 


62. 




65.7 


(25) 


205. 0 


.72) 


206.8 


(72) 


190.4 




167.0 


(t>5> 


29.9 


(11) 


)9.4 


(11) 


28.2 


(1- 


25.0 


(10) 


284.) 




287.) 




281.) 




257.7 




14 




)7 




)9 




155 




16.9 


(4) 


40,4 


(9) 


65.9 


Cl'l 


116.5 


(26) 


419.7 


(91) 


40). 6 


(67) 


165 ) 


(76) 


)29.0 


(71) 


21.4 


(5) 


20.5 


(4) 


)6.4 


(7) 


:5.6 


()) 


460.0 




464.5 




507 6 




46). 2 





56 




46 




4 




12) 




4). 4 


(52) 


50.6 


(60) 


56.5 


(7i> 


64.2 


(75) 


1).) 


(16) 


4.1 


(5) 


1.6 


(4) 


1.2 


(1) 


26.2 


02> 


29.5 


(15) 


19.1 


(24) 


20.1 


(24) 


6) 0 




«.5 




81.2 




65.5 




)54 




/ 197 




171 




4)7 




71.2 


(4)> 


61.9 


(50) 


61.0 


09) 


88.0 


(61) 


60 0 


(42) 


50.2 


00) 


60.1 


06) 


)1.4 


(22) 


25.4 


(15) 


)2 6 


(20) 


)7.0 


(21) 


24.9 


(17) 


165.4 




164.7 




156.2 




144.) 




176 




107 




6) 




)7 




92.1 


Ol) 


106.5 


06) 


74.) 


(26) 


79.9 


(26 


181.7 


(60) 


141.7 


(49) 


158.) 


(55) 


194.1 


(64) 


27.9 


(9) 


4). 8 


(15) 


55.1 


(19) 


29 6 


(10) 


)01.7 




294.0 




287.6 




)0).6 




122 




42 




17 




14 




7) 1 


(14) 


67.1 


(D) 


58.6 


(12) 


79.4 


(17) 


419.4 


(79) 


422.4 


(62) 


401.2 


(8)) 


)58.0 


(7'') 


)6.5 


(7) 


25.) 


(5) 


2). 4 


(5) 


28.6 


(6) 


529 0 




514.8 




48). 2 




466.0 





22) 

57.4 (72) 
).) (4) 

19.2 (24) 
79.9 

440 

84.5 (55) 
44.1 (26) 
26.0 (17) 

154.6 

107 

62.4 (27) 
194.) (64) 

27.) (9) 
)04.O 
51 

2).9 (5) 
440.9 (91) 

19.5 (4) 
484.) 



56 

42.0 (62) 
5.5 (8) 

20.: 00) 

67.7 

180 

59.6 (41) 

59.5 <41) 

26.7 (18) 
145.6 

77 

41-7 (16) 
190.4 (71) 

)5.2 (1)) 
269.) 
16 

51.6 (D) 
))9.7 (84) 

14.9 (4) 
406.2 



58.6 (62) 

1.7 (2) 

11.1 (16) 
71 5 

144 

54.1 IV) 
58.6 (40) 
)2.7 (22) 
145.4 
62 

8).0 <)4) 
126.4 (52) 

)).l (14) 
242.6 
14 

)9.1 (10) 
))\. 5.(66) 

14.9 (4) 
)89 6 



256.9 
54 





222 




(7)> 


50.) 


(7)) 


(1) 


2.7 


(4) 


(25) 


16.) 


(2)> 




69.4 






671 




(66) 


77.5 


(61) 


(21) 


26.2 


(21) 


<1)> 


22.6 


(1C) 




126.5 






129 




()0> 


92.6 


OS) 


<59) t 


153.9 


(58) 


(10) 


19.5 


(7) 




266.1 






)9 




()2> 


62.5 


(15) 


(65) 


121.6 


(80) 


O) 


20.) 


(5) 




404.5 





The four coat level* 
kind* of Instruction 



were obtained 
were obtained 



by collapsing the eight l*v*l* explained In Table 0-6 
by cceblnlng the flret three, nest four, and the last 



three Instruction*! **ttlng* *hovn It Table *>-*■ 



er|c 



4 r » •* 

* <~> %9 



380 



Analysis of Variance of Reading Achieveae' t Grow**. ;/ O *»ca*-o3 (JE Students Tv comparison Groups of Non-CE Students) • 
and Two Factors Nested «itr \n the CE Group: Four I i i».*.ndaid-R.*ot.rce-Dol* lr /bsts for Reading Se-viccs and Three CE Cat ego He 



hi Treatment 



B(A) : 
CE Group 

C(A)L 
Cost 
Level' 



Title X Students in 
Title X Schools 



CE Students 



Other-CE Students i 
Title Z Schools 



Low High 
Average Average 



High 



I-ow Hlah 
Average Average 



High 



C£ £»tudenti in 
^th^t'-Ci: Schools 

1 Low High 
Avorage Average 



High 



Needy Non-CE 
Students in 



Non-CE CE 
Schools Schools 



ANOVA Test Statistics*** 



Test 
I 



Test 
II 



Test 
III 



Test 
IV 



Test 
V 





Sample 


192 


686 


-0.01 


0.03 


251 


748 


0.02 


0.10 


187 


750 


0.05 


0.07 


201 


449 


0.03 


-0.02 


142 


493 


0.03 


-0.00 


86 


432 


0.03 


-0.00 



Sizes (F*rat Row for Each Grade, emitted £n Three Lower Sections) and Mean Gains in Terms of Standardized (z) Scores 



444 
0.11 

522 
0.03 

473 
0.09 

412 
0.07 

372 
0.04 

373 
0.08 



234 
0.04 

284 
0.03 

292 
0.08 

256 
0.06 

218 
0.01 

235 
0.12 



102 
-0.06 

90 
-0.11 

97 
-0.06 

60 
-0.06 

80 
-0.09 

148 
-0.02 



250 


98 


69 


22 


151 


110 


56 




1.240 












-0.14 


-0.03 


-0.23 


-0.06 


-0.19 


-0.15 


-0.29 


^07 


-0.07 


2.02 


0.00 


8.62* 


1.96 


0.84 


318 


130 


45 


15 


'l88 


169 




• 320 


950 












-0.02 


0.01 


-0.06 


-0.11 


0.16 


0.09 


0.03 


-o.ol 


0.02, 


1.33 


0.22 


2.89 


2.18. 


0.63 


238 


94 


49 


62 


157 


134 


59 


323 


902 












-0.03 


0.03 


0.2J 


-0.05 


0.03 


0.12 


-0.16 


0.04 


0.04 


0.16 


0.07 


3.09 


2.18 J 


2.94* 


179 


111 


54 


65 


210 


96 


31 


340 


I.. 046 












-0.00 


0.01 


0.06 


0.10 


-0.01 


-0.08 


-0.05 


0.0? 


0.01 


0.17 


0.09 


0.82 


0.35 


1.3* 


180 


97 


37 


33 


189 


117 


46 


266 


1,187 












-0.03 


-0.00 


-0.09 


-0.04 


0.05 


0.04 


0.05 


0.01 


-0.00 


0.21 


0.06 


2.68 


0.62 


0.49 


259 


97 


35 


41 


18^ 


95 


30 


351 


1.367 












0.00 


0.03 


0.09 


-0.17 


-0.04 


-0.03 


-0.02 


0.01 


0.00 


1.17 


0.14 . 


S.8JL*^ 


2.45 


0.66 



Mean Residual Gain Scores Based on the Estimated Regression Using Data from Non-CE Students Attending Non-CE Schools* 



Gr. 


1 


0.45 


6.65 


10.06 


6. 


10 


-1.46 


Gr. 


2 


-1. 37 


2.38 


-1.10 


-4->09 


-1.86 


Gr. 


3 


-2.54 


-0.96 


0.82 


-2. 


60 


»-6.27 


Gr. 


4 


-1.50 


-2.09 


2.50 


1. 


52 


-3.31 


Gr. 


5 


9.20 


9.77 


17.54 


12. 


89 


1.74 


Gr. 


6 


-3.53 


-6.67 


-1.72 


0. 


34 


-0.73 








Mean Residual 


Gair 


Scores 


Gr. 


1 


-3.15 


3.46 


8.18 


4 


95 


-0.81 


Gr. 


2 


-3.66 


1 .30 


-2.26 


-3 


52 


-3.02 


Gr. 


3 


-0. 10 


0.81 


3.0$ 


0. 


07 


-8.41 


Gr. 


4 


-0,33 


0.69 


4.54 


4 


13 


-4.23 


Gr. 


5 


3. 20 


-1.64 


1.57 


-1. 


98 


-6.27 


Gr. 


6 


2.24 


2.37 


9.16 


11. 




0.86 


Gr. 


1 


58.83 


60.29 


64.82 


60. 


12 


59.59 


Gr. 


2 


43.26 


46.93 


43.11 


41.83 


38.47 


Gr. 


3 


34.78 


34.31 


36.76 


35.29 


26.92 


Gr. 


4 


31. 31 


28.10 


34.73 


33.61 


25.55 


Gr. 


5 


2R.94 


25.19 


28.09 


25.83 


19.93 


Cr. 


6 


26.73 


23.45 


29.77 


32. 


43 


25.15 



-3.06 
-1.22 
-5.95 
-3.92 
7.00 
3.07 



-6.39 
-1.54 
-4.99 
-2.76 
-1.63 
0.20 



57.21 
42.09 
28.91 
30.08 
24.07 
24.68 



1.46 
1.50 
-4.35 
-3.82 
8.43 
-2.62 



-0.09 
1.65 
-3.63 
-4.60 
-2.93 
4.64 



-9.59 
-8.18 
1.17 
-1.81 
3.89 
1.85 



-7.00 
-6.48 
4.81 
-1.06 
-12.79 
10.49 



1.39 
-1.87 
-6.52 
5.18 
9.02 
17.20 



2.54 
-4.43 
-5.84 

5.95 
-7.30 
•11.82 



-6.04 
6.10 
-4.72 
-4.35 
15.13 
-9.30 



-6.84 
5.99 

-2.29 
1.34 
5.94 
1.06 



-2.20 
1.2J 
3.15 
-5.87 
11.30 
-11.02 



-2.08 
2.08 
5.59 
-3.25 
-1.42 
-0.22 



-10.59 
-4.03 

-16.71 
-6.06 
17.20 

-10.85 



-11.51 
-2.13 
-13.43 
-0.49 
0.27 
0.89 



59.61 
44. 38 
32.05 
29.36 
24.9 3 
26.48 



Mean Gains in Terms of VSS Scores 
47.78 ' 60. SO 53.85 54.84 



38.64 
43.18 
33.33 
17.97 
31.37 



'3.53 
28.94 
36.71 
21.58 
11.76 



50.37 
33.39 
28.50 
30.26 
21.61 



46.27 
40.30 
22.82 
27.41 
22.12 



46.93 
42.83 
22.19 
23.45 
31.28 
23.27 



0.4' 


3.84 


1.19 


7 

4.92* 


15.07* 


"2.73 


1.20 


-3.1-1 


1.02 


1.89 


2.14 


0.45 


3.30 


0.61 


-1.27 


2.78 


9.16* 


13.06* 


3.96 


2.72 


2.54 


0.63 


1.78 


2 8i 


3.41 


1.69 


0.67 


1.16 


0.76 


5.72 


16.35* 


8.84* 


4.68* 


1.07 


1.13 


-6.21 


-5.94 


1.17 


0.11 


f.60* 


0.55 


0.80 


Students Attending CE Schools 








-2.75 


0.30 


1.67 


1.38 


8.98* 


2.70 


1.82 


-0.35 


3.02 


4.13 


4.13 


0.42 


2.34 


0.66 


0.50 


3.66 


5.77* 


9.62* 


5.02* 


2.98 


2.89* 


-1.15 


3.81 


3.51 


4.42 


3.L7 


0.18 


1.08 


-3.24 


2.13 


3.78 


5.54* 


3.78 


1.7$ 


1.99 


2.97 


2.96 


0.42 


0.03 


5.41* 


3.33, 


1.01 



53.50 
40.37 
33.81 
30.75 
24.48 
24.98 



54.92 
43.02 
34.14 
29.88 
25.07 
24.28 



8.47* 

2.12 

0.01 

0.18 

0.64 

0.88 



1.68 
0.79 
0.30 
0.08 
0.09 
0.11 



5.48* 

1.07 

2.53 

1.43 

2.82 

4.88* 



3.05 
2.08 
2.47 
0.27 
0.48 
1.93 



1.05 



3W 

1.^8 
0.9} 
0.71, 



F ratio is significant at tho -01 level. 



for all CE students 
zero to one s.d. 



ERIC 



The four cost levels are defined in terms of the mean and standard deviation (s.d.) of the total resource costs of reading services 
within each grade as follows. Low ■ one or more s.d. below the mean. Low Average ■ zero to one s.d. below the mean; High Average » 
above the mean; and High » one or more s.d. above the mean. The lower end point of each level is excluded ftcm that level, 
i ■ <• 

The five ANOVA tests of effects are. I - Effect of A; II - AjB(A) ,C(A) , B(A) *C (A) , Ixl - B(A) j A,C(A) ,B<A) *C(A) i IV - C(A) j A,B(A) ,B(A) *C(A) j and 
V - B(A)*C(A)|A,B(A),C(A), where the symbol '|* represents 'conditional on the presence of the effects followed*. 



Tabls D-13 



At Treatment 



B(A): I 
CE Group 



Title X Students in 
Title X Schools 



C(A): 
Cost 
Level* 



Low 
Average 



High 
Average 



High 



Sample Sizes (First Row 



CE Students 



Other-CE Studen 
Title X School 



Low High 
Average* Average 



High 



CE Students in 
Other-CE Schools 



LOW 

Average 



High 
Average 



High 



Needy Non-CE 
Students in 



ANOVA Test Statistics*** 



Non-CE 
Schools 



CE 
Schools 



Test 
I 



Test 
II 



Test 
III 



Test Test 

XV V 



for Each Grade* 



Omitted in Three Lower Sections) and Mean Gains in Term, ot Standardized U> Scores 



- 




42 


356 # 


255 


119 


jar. 




-0.01 


-0.19 


0.04 


0.08 


Gr. 




64 


429 


244 


165 


2 


t0.11 


0.07 


0.03 


•0.01 


Gr. 




77 


398 


281 


• 164* 


3 


0.02 


0.14 


0.17 


0.12 


Gr. 




58 


354 


176 


122 


4 


-0.04 


-0.04 


0.16 


0.32 






58 


313 


204 


141 


Gr. 


5 


-0.01 


0.17 


o.otf 


0.13 


Gr. 




56 


275 


156. 


155 


6 


-O.lP 


0.12 


0.11 


0.24 








Mean 


Residual 


Gain 


Gr. 


1 


6.81 


12.48 


13.35 


7.97 


Gr. 


2 


-1.87 


3.27 


0.56 


1.67 


Gr. 


3 • 


2.72 


14.87 


18.57 


17.22 


Gr. 


4 


-5.54 


-7.72 


9.30 


19.09 


Gr. 


5 


4.18 


8.49 


8.33 


8.51 


Gr. 


6 


-13.13 


12.80 


9.67 


19.31 








Mean Residual Gai 


Gr. 


1 


1.27 


5.62 


6.15 


0.20 


Gr. 


2 


-9.54 


* -0.69 


-6.23 


-4.00 


Gr. 


3 


-11.63 


-1.72 


1.09 


-0.07 


Gr. 


4 


-8.36 


-12.91 


1.09 


10.54 


Gr. 


5 


-1.56 


6.18 


5.83 


7.12 


Gr. 
i 


6 


-10.33 


11.67 


11.64 


21.73 



111 


218 


81 


16 


8 


95 


-0.27 


-0.17 


0.20 


0.24 


-0.16 


-0.09 


82 


265 


106 


24 


. 2 


70 


-0.05 


-0.05 


-0.11 


-0.22 


0.64 


-0.14 


69 


201 


85 


30 


20 


„ 152 


0.14 


-0.05 


,0.06 


-0.03 


0.03 


-0.02 


48 


197 


107 


42 


4 


171 


-0.14 


-0.01 


0.04 


0.02 


-1.14 


-0.08 


49 


179 


102 


20 


16 


164 


-0.12 


-0.04 


-0.0J 


0.00 


-0.05 


-0.01 


56 


380 


77 


36 


6 


144 


0.04 


-0.01 


-0.04 


0.03 


0.05 


0.03 



83 
0.02 

67 
0.u6 

45 
0.00 

63 
-0.60 

52 
0.11 



24 


591 


966 






0.34 


-0.14 


-0.01 


8.15* 


6.37* 


26 


555 


762 






-0.06 


-0.02 


0.02 


0.44 


0.39 


33 


- 615 


818 






-0.62 


-0.05 


-0.04 


8.71* 


0.76 


17 


671 


821 






0.16 


-0.02 


0.00 


0.15 


3.68 


14 


723 


936 






0.04 


0.02 


0.04 


0.83 


0.38 


14 


739 


1,061 






0.16 


-0.03 


-0.02 


4.34 


1.05 



14.44* 



3.46 



3.32- 

0.73 

3.68 

8.56* 

0.85 

3.09 



3.84* 

1.13 

3.57* , 

8.56* 

0.63 

2.92* 



from Non-CE Students Attending Non-CE Schools 



Gr. 
Gr. 
Gr. 
Gr. 
Gr, 
Gr. 



57.79 
46.69 
49.08 
46.83 
43?28 
27.63 



65.4*7 
56.26 
55.47 
44.57 
49.50 
45.77 



59.59 
51.99 
58.26 
57.95 
43.18 
44.63 



57.55 
51.35 
56.54 
68.63 
45.69 
54.97 



-6.23 


2.39 


8.70 


-3.68 


-8.74 


-2.58 


1.69 


1.52 


-13.99 


53.31 


3.24 


-3.87 


-3. CI 


-7.84 


-7.90 


-2.03 


0.98 


2.11 


-10.65 


-59.81 


-5.37 


1.92 


-1.11 


-21.42 


-9.76 


1.89 


1.07 


-4.19 


^.43 


-8.96 



2.37 
-9.40 

3.59 
-3.11 

0.65 

2.12 



7.35 
7.54 
10.51 
-44.40 
' 2.21 
-14.63 



12.40 
-0.34 

-15.17 
1.91 

-10.00 
-0.56 



0.65 
-2.55 
-0.07 
-1.38 

0.21 
-0.43 



8.39* 


2.52 


5.44* 


2.36 


0.76 


2.64 


3.13 


2.81 


2.54 


2.67 


13.63* 


1.09 


20.51* 


2.78 


2.91* 


1.47 


6.03* 


11.71* 


5.39* 


13.96* 


4.45 


7.01* 


8.34* 


2.02 


0.85 


3.62 


2.98 


3. .06 


3.34. 


2.19 



Scores Based on the Estimated Regression Using Data 

4,58 
7.21 
-7.32 
-45.70 
0.73 
-13.51 



from Non-CE Students Attending CE Schools 



10.04 
-5.42 
-*.71 
-4.5,6 
•11.92 
-0.90 



-3.43 
-2.28 
-8.81 
-1.42 
-1.80 
-0.80 



-9.97 
-14.44 
-20.65 

-8.99 
-21.72 
4.66 



-9.31 
47.29 
•11.73 
•63.63 
•11.21 
-9.36 



-2.58 
-11.91 
-4.85 
-8.91 
-0.37 
3.18 



Mean Gains in Terms of VSS Scores 



51.27 
52.38 
59.45 
44.94 
32.43 
40.86 



54.80 
52.67 
49.83 
50.78 
38.96 
36.94 



65.42 
50.43 
51.67 
52.95 
37.49 
37.52 



61.31 
43.29 
40.97 
46.74 
30.85 
45.14 



50.50 
103.00 

52.80 
-26.00 

35.50 

41.83 



54.42 
44.34 
S6.07 
43.15 
38.63 
39.73 



61.90 
57.43 
52.31 
9.41 
47.77 
20.44 



9.12 
-2.58 
-39.00 
-3.66 
-9.20 
2.58 



66.75 
51.15 
15.27 
55.82 
37.00 
46.71 



-3.79 
0.64 
-7.77 
-11.33 
-1.41 
-6.14 



49.34 
48.55 
50.59 
46. 4? 
38. 9o 
*34. 40 



-0.15 
4.82 

-7.83 

-9.14 
3.71 

-0.67 



54.05 
51.91 
48.86 
48.55 
41.32 
36.21 



5.24* 
10.84* 
2.6,8 
2.54 
2.79 
14.71* 



18.76* 
2.36 
4.41 
0.52 
1.68 
6.9*>* 



2.30 


3.30 


2.66 


1.16 


2.55 


2.13 


2.51 


3.10* 


0.56 


8.10* 


5.79* 


4.90* 


0.83 


9.34* 


4.88* 


10.01* 


5.22* 


7.54* 


2.0V 


0.66 


4:84* 


4.24 


2.44 


2.03. 



9.34* 

2 ..49 
0.33 
3.28 
0.56 
2.19 



0.18 
. 1.70 
4.56 
13.43* 
3.83 
0.62 



1.61 

1.34 

6.24* 

6.76* 

0.59 

2.87 



2.50 

1.95 

5.08* 

8.95* 

0.6S 

2.03 
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V ratio is significant at the .01 level. * .-rv'ees for all CE Students 

four con l.v.l. in e.» of «. -J*--*, L2\T£ ' — - _ - 

within «ch grid, follow.: low - on. or -or. •£ bolow "J™ ™ \ f Mch ,.„., „ excluoM fro. that U»l. 

^ov. th. «», «- Hl 3h - on^or »r. ..d . *ov. h. «„. £ ~ * . B(A) , A , C(A) , 8(A) . C(A)! W . c«lM<M.B«>«C«>. - 

■ ■ " 407. 



Table D-U 



^MMA_»McUn$ Mtehievemmnt Growth- In Term* of Standardized U) Scores for Subgroup* of Ct Student! Clesslf led by 
T^eTrlEareereri sties -and by rour-t*v«l» of j;t*M«rd-Doll«r-Ni»c>urc« Coit in Heading * 



G 
R 

A Cost 
D Uvtl 
E (8)* 




Student Characteristics (Aj) ( f 


ftace/tthnlclty (Aj) 


Free Me*ls-Progr«ja (Aj) 


Need for CE <f. 3 ) 


Pretest Achievement Quertlle <A 4 ) 


White Minority 


Participant Non-Pert ic. 


Seed «No Need 


lowest Second 


•inira nignvav iuiai 


H Mui N Mean 


N Mcen H Heen 




* H Mean H Mean 


H Mean N Mean ^ N Mean, 


Low 1 
Low- Aver age 
1 High-Avtrege 

High 

TOtel 
r-Tests for 

B|A 1 ,A 1 *6 

ai.bIaj.b 


149 -0.15 167 0.09 
541 -0.21 546 0.13 
324 -0.12 328 0.21 
260 -0.11 99 0.05 
1.274 -0.16 1.140 0.14 

1 {■« 


198 0.01 118 -0.09 
614- 0.01 473 -0.10 
397 0.16 255 -0.13 
197 -0.01 162 -0.12 
1,406 0.05 1.008 -0.11 

0.89 


166 -0.07 150 0.02 
699 0.00* 388 -0.11 
462 0.04 190 0.04 
299 -0.O8 60 0.02 
1.6^6 -0.01 788 -0.04 

1.57 


12? 0.20 98 -0.04 
422 0.26 367 -0.11 
310 0.36 173 -0.02 
169 0.26 125 -0.23 
1,028 0.28 763 -0.10 

1 


. 39 -0.06 -0.53 316 -0.03 
* 173 -0.21 125 "0.59 1.0.87 -0.04 
85 -0.39 84 -0.58 652 0.04 
50 -0.54 15 -0.68 159 -0.06 
247 -0.29 276 -0.58 2,414 -0.02 

05 
70 


Low 

Low-Aviri9» 
2 High- Average 
High 
Total 

r-Ttiti for 
ftlAi.A^C 
A^BUi.S 


177 0.01 179 -0.05 
749 0.10 505 0.04 
462 0.0b 359 0.00 
253 0.07 130 -0.07 
1.641 0.08 i„m 0.01 

0.40 


234 -0.00 122 -0.05 
663 0.03 591 <0.13 
439 0:01 382 0.07 
178 -0.03 2C5 0.06 
1.514 0.01 1.300 0.09 

2.63 
1 .07 


190 0.02 166 -0.06 
889 0.10 365 0.02 
676 0.04 145 0.05 
349. 0.04 34 -0.18 
2.104 ,0.06 710 -0.00 

2.39 
1 .16 


148 0.24 89 -0.13 
606 0.24 394 -0.03 
422 0.24 270 -0.14 
209 O.ia 146 -0.17 
1.385 0.23 899 -0.10 

1. 
0. 


61 -0.19 58 -0.32 356 -0.02 
171 -0.05 83 -0.32 1.254 0.08 
96 -0.18 33 -0.42 821 0.6*4 
23 -0.18 5 -0.24 383 0.02 
351 -0.12 179 -0.34 2.814 0.05 

Pi 
70 


Uy 

Lo<3r* Average 
J High- Aver ege 
\ High 
Tote'l 
F-Teats for 

b|ai*V b 

Al»B|Ai,8 


198 0 01 148 -0.01 
610 0.01 535 0.08 
382 0.09 319 0.08 
236 0.04 164 0.09 
1.426 0.04 1.166 0.07 

2.28 
1.02 


192 -0.02 154 0.02 
C96 0.07 449 -0.01 
399 0.08 502 0.10 
208 0.09 192 0.03 
1.495 0.06 1.097 0.03 

2.46 
1.52 


183 0.03 163 -0.04 
830 0.07 315 -0.04 
613 0.09 88 0.07 
37; 0.05 23 0.24 
2.003 0.07 589 -0.02 

2.84 

J. 37 


150 0.08 113 -0.01 
631 0.16 308 -0.03 
414 0.20 207 -0.04 
270 0.19 99 -0.11 
1.465 0.17 727 -0.04 

3. 
2. 


62 -0.11 21 -0.25 346 -0.00 
122 -0.15 84 -0.30 ..145 0.04 
64 -0.12 16 -0.27 701 0.09 
29 -0.43 2 -1.23 400 0.06 
277 -0.17 123 -O.30 2.592 0.05 

46 
12 


Low 

Low-Average 
4 High-Avtrage 
High 
TOtel 

,,F-Tests for 

&]ai.Ai*B 

Ai*B|Ai,B 


215 0.06 117 -0.03 
463 -0.00 375 -0.03 
348 0.03 271 0.05 
178 -0.03 163 0.1* 
1.204 0.01 926 0.02 

1.68 
3.13 


170 '0.01 162 0.06 
473 -0.02 365 -0.01 
352 0.04 2£7 0.03 
216 0.06 125 0.03 
1.211 0.02 919 0.02 

1.35 
0.53 


191 0.05 141 -0.00 
592 -0.00 246 -0.05 
545 0.03 74 0.08 
310 0.04 31 0.14 
1.638 0.02 492 -0.00 

2.13 
0.87 


168 0.10 76 0.01 » 
468 0.03 229 -0.04 
420 0.08 146 -0.05 
225 0.15 8P -0.14 
1.281 0.08 539 -0.05 

1. 


50 -0.06 38 -0.17 3)2 0.03 
96 -0.09 45 -0.18 838 -0.0S 
43 -0.14 10 0.23 619 0.04 
26 -0.1* 2 -0.18 341 0.05 
215 -0.10 95 -0.13 2.130 0.02 

10 
40 


Low 

Low- Ave rage 
S High-Average 
High 
Totel 
r-Tests for 

8|A i .A i sB 

ai«b|ai,8 


179 0.02 76 -0.10 
431 -0.02 431 0.02 
278 0.05 308 0.02 
137 0.03 164 -0.01 
1.025 0.01 979 0.00 

1.22 

1 .70 


115 -0.10 140 0.05 
531 -0.00 331 0.01 
J66 0.03 220 0.03 
204 -0.05 9? 0.12 
1.216 -0.01 788 0.04 

1.05 


165 -0.02 90 -0.01 
690 0.01 172 -0.03 
525 0.03 61 -0.00 
278 0.01 23 -0.0b 
1.658 0.01 346 -0.02 

0.29 


114 0.08 73 -0.10 
497 0.06 250 -0.07 
590 0.07 It) -0.03 
228 0.06 64 -0.16 
1.229 0.06 540 -OttW 

0. 
0. 


42 0.13 26 -0.02 255 -0.02 
80 -0.11 35 -0.00 862 0.00 
35 -0.06 8 -0.29 5B6 0.03 
8 -0.14 1 -0.06 301 (r.OO 
165 -0.11 70 -0.04 2.004 0.01 

58 


Low 

Low- Ave rage 
6 High-Average 
High 
Total 

F-Testi for 
BjAi.A^B 
Ai*»|A1.8 


225 -0.0. 50 -0.08 
405 0 01 471 -0,03 
240 0.C4 '25 0.06 
138 0.C6 162 0.14 
1.00ft' 0.02 1.008 0.02 

5.88- 
1.59 


102 -0.07 173 0.00 
529 -0.02 „ 347 0.00 
358 0.05 207 0.06 
202 0.12 98 0.07 
1.191 0.02 825 0.02 

5.32" 
0.74 


148 -0.02 127 -0.04 
632 0.00 244 -0.03 
4" J 0.03 87 0.14 
276 0.10 24 0.16 
1.534 0.03 48? 0.01 

6.08" 
1.79 


108 0.06 81 -0.10 
505 0.03 243 *0.0J 
402 0.09 139 -0.04 
209 0.13 66 0.05 
1.2.4 0.07 549 -0.03 

0. 
0. 


49 -0.08 37 -J. 04 275 -0 03 
88 -0.^9 40 -0.19 876 -0.01 
19 -0.00 5 -0.25 565 0.05 
5 -0.03 (0) — 300 0.10 
161 -0.07 82 -0.13 2.016 0.02 

Mt 

a 



The four cost-levels for reading are defined in terms of the mean and standard deviation ts.d.J of the total resource cost of reeding services /or 
all CE students within each grade as follows. Low - one or no re below tht mean* Low-Average • zero to one e.d. below the meant H.gh-Average ■ 
zero to one s.d. above the Mini and Hlgb " ore or more *-d. above trie mean. The lower end point of «*ch level Is excluded from that level, 
r retlo Is significant at the .01 level 



^ Is not unique because of the empty cell. 
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Table &-15 

M**n Heading Achievaawnt Growth in Teme of Utalduil CaU Scorei Baaedo* the tatleated Fwgraiaion 
' Ueing Oat* rroM moo*CB Students Attending Hon-OS Schools, for Sufcgrovps of Ct Stwdenta 

Cleaaified by Their Cherecterlctlce *nd by Four Levsle of StawUtd-Itesource-Dolier Coat in Feeding 



Student Cbsreetariatlcs (Aj) 



c 

J Cb«t Race/Ethnicity (Ai> 


— — 1 

Free- Ha* la Progra* iAj) Need for C£ (A j) 


Achleveawnt ^trtlle {A4I 
- Total 


t Uvtl . 

E 1 Whit* Minority 


P .rticlp*nt Need 


Lowe at Second ^thlrd Higheat 


Low" -10.96 9.59 
L&v-Av«r«9« -8.04 13.25 
1 High-Averaga -2.45 IS. 73 ' 
High . -2.98 9.57 

Total J s.9) 13.11 
r-T»»t» fori 
>lA i *A k «B 

a^bIa^b 1.)) 


%.J4 -9.07 3.72 4.)) 
7.71 -).91 8.65 -8.15 
1^.56 -3.99 10.32 -7.11 

OivJ V ■ *v • ■ vv « . # * 

8.78 -4.91 7.56 -6.21 

v 2.98 )-18 , 
• 1.00 o l-Jt 


-1.40 1.96 3.96 -).86 -0.10 
2. >6 3.0* 6.)5 -4.18 2.64 

10.6) 6.56 2.64 -1.4) 6.70 
2.40 -).08 -5.92 D.29 0.48 
4.60 ).01 3.^1 -2.94 ).06 

0.75 
1.56 


!ov -2.48 -0.55 
Low-Average 1>51 *.'* 
2 High-Averaga 0.3' -0.95 
High ■ "J.e* "w»*e 
Total -Q-04 0.1) 

r-7*ata fori 
BlAt.Ai«B 

A1«B?A1.B 0.S2 


•-1.60 -1-35 -4.1) 1.48 
-1.)) 5.79 1.97 2.16 
-).)2 ).)' "0-49 1.11 
-9*5) -0.24 »4.0J -10.08 
-2.91 \46 -0.37 1.20 

4.74«« ).18 
1.19 1-0' 


-2.4) - -2.11 l.)4 -1.27 -1-51 
-0.67 2.85 9.94 1 48 2.0) 
-1.04 -2.41 9.64 -0.2) -0.21 
•6.84 -).86 10'.65 0.36 -4.56 
-1.90 -0.)1 P. 41 0.24 0.0) 

1.40 
0.56 


to* ' .-6.33 -1.58 
Low-Average -6. '5 2.)2 
) H19h-Avarege» 0.19 1.0) 
H10h -7.»< 0.99 
Total -*.01 1.28 

l-Taat« fori 
•I'At.AiiB 2.61 

a^bIa^b )i) 


-4.)2 -4.28 -0.34 -6.75 
-0.85 -5.08 -0.07 -8.95 
-0.27 1.49 1.9) -8.?0 
-4.2) -4.20 >4.)9 -1.4) 
-i.61 -2.95 -0.29 -8.59 

).6*1 0.16 
1.70 1.2C 


•7.26 \0.12 -5.60 »).09 -4.)0 
-4.19** 3.84 -5.J9 -9.02- -2.51 
-1.58 4.8) 4.08 -12.91 0.57 
-5.07 1.15 -12. )7 ^36.35 -4.22 
-3.93 3.18 -3.98 -8.96 -2.18 

1.38 
0.96 


Um 2.7) -6.70 
Low-A V «r*9« -0.80 -5.8) 
4 Htgh-Aver*je 0.18 -0.0' 

High -J.*J 4.60 
Total -CJO -2.42 
P-Tests fori 
b] A} • AjfB 1.(4 
A 1 >B*A| t B 4.24»* 


-4.92 1.95 1.92 -4.00 
-J.o3 -2..30 -0.27 -9.74 
0.18 -0.07 0.49 -2.98 
0.45 -0.64 0.82 -4.91 
-1.90 -0.)) 0.44 -6.77 

lilt *■» 
1.55 0.55 


0.17 -2.03 1.00 -3.96 -0.59 
-4.01 -2.75 0.89 -2.9/ -3.05 
0.47 -1.98 -1.5$ 20.32 0.07 
3.73 -8.36 v. 30 -4.67 0.30 
-0.63 -3.36 0.49 -0.95 -1.22 

1.11 
1.24 


Low 10.8) -2.58 
bow-Av«rage 9.6' 10.87 
5 High-Av«rag« IS. 46 14.18 
High 14. '5 10 - 52 
Total 12.20 10.81 

r-Te«t« fori 
BlAj«A| a B 4.91" 
A t «BtA ( ,B 


0.62 11.94 10.81 -0.46 
9.80 11-78 V*- 68 -6.9) 
D.98 16.1) 16.67 -1.41 
6.95 24*00 14.47 -12.02 
9.71 U.;)2 14.89 -4.61 

4.64»* 0.87 
).9*»»» 1 48 


11.80 4.05 -2.51 7.96 6.63 
12.42 8.-8 3.27 11.02 10.37 
15.84 14.06 10.33 -3.19 14.79 
15.02 5.01 -2.90 24. 11 »12.44 
13.93 9.05 3.00 8.45 11.52 

o.# 
0.55 


Low -,-2-4* -11.28 
Low-Average '-).!' -8.74 
6 High-Average -5.91 -1.61 
High -«■« 
Total -4.79 
r-Teats fori 

A^hUi.P 4.C6** 


-4.49 -).81 -8.68 I.J1 
-6.41 -5.79 -7.18 -1 :* 
-1.17 -7.00 -1.16 6.02 
2.48 -6.97 -0.7) 0.05 
-).22 -5.82 -5.5) -0.)2 

0.9) 2 « 
~ 1.94 1-20 


-3.91 -14.77 1.55 11.49 -4.0* 
-'.61 -8.08 -1.05 -0.11 -6.16 
-1.83 -8.97 4.47 -8.32 -3.44 
1.69 -5.97 -4.34 — -0.61 
-3.38 -8.96 0.29 4.62 -4.29 

0.40* 
0.95 



The ?our cost level a for reading era defined in terms c f 
services for all a ttudenta within aech grade as follows 
the a\eeni High- Ave race - *»ro to oca a.d. abova tha »eani 
lavel if axcluded froat that level, 
"r-retio !• aignlflcant *t the .01 level, 
^ett la not unique baceu»e of the «»Pty cell. 
Note. — Sa»ple aixa* era provided in Table D-14 



tha Man end atandard daviation t«.d.J of tha total raaourca coat of reading 
Low • one or ewre a.d. below the ■aani low-Average - «aro to one a. d. below 
and High " one or acre a.d. above the »ean. 



The lower «nd point of «ech 



40:-) 



ERIC 



384 



Mua XchrVv^wnt Crovth In T*rm« of **sid\ul Calrt £oor*i>»«i*d on th« t»tlfc*t«d «*e«r«siion 

Ctlrxj t*t« fro* Non-CS Stud«nti Attending CE Schools, for Subgroup* of GE Students CUislfled 
by their Ch4r«ct«rlttlca *nd tf four Levels of Stand* rd-"**»o\irc«-DoU^r Co»t In Aeedlng,, 



Student Ch*r*ct«rir«tlce i*i> 



A Cost 
D Uvtl 
t CM* 



ftece/cihnlcltv fAii 



*rtlt« Minority 



rr**»H*«lt r^CKjr« M}> for CT (A)) 



*Won- 
rartlclpent 



H»«a HO N»ed 



Achievement Quart lie CA4I 



Lov«tt Second Third Highest 



LOV 

Lov*AV«ro9« 
MlgVAverog* 
Mian , 

Tot«l 

f-Ttsts Con 
*l*i.*l'«» 
Al"»l»l.» 



-9.29 

-2.01 
-0.99 
-5.2) 



4. SO 
7.52 
12.14 
2.91 

■.01 

4. 46" 
2.17 



,0.14 

2.16 
10. u 
2.58 
4. St 



•6.77 
-1.66 
-J. 11 
•2.95 
-J. 86 



1.42 
S.2S 
8.27 
2.62 
5.2J 



-S 71 
-10.12 

-2.24 
■12. SS 



-4.47 
-l.U 

«.J4 

3.01 
1.97 



0.6S 
0.S0 
, 4.72 
-1.0J 
1.60 



J.4? 
4.*7S 
1.S0 
-3.JS 
^.77 



-4.01- 
'6.96 
-J.70 
, 7.87 
-4.79 



-2.00 
-0.2 j . 
S.21 
0.08 
1.05 



J. 07 
1.61 



1.87** 
l.Jf 



1.J1 
1.8J 



HlgV*Ve/"9e 
High 
Total 
f-Tttts fori 



-2.56 • -4.S0 

3.41 -0.39 

l.tr -).7i 

-1.14 -8.20 

1.C7 -2.92 

1.45 
0 45 



-4.26 
-2.99 
-4.94 
-9.69 
-4.S4 



•2.1* 
6.08 
4.07 
1.S6 
4.01 



-1.S6 
).07 
0.04 

-2.1? 
0.60 



-).W 
■J.08 
• 4.41 

-l?.oj 
-4.12 



•1.74 
•0.65" 
•1.58 
-4.88 
-1.90 



3.59 
1.20* 



J. SO 
1.S8 



-4.87 -2.50 

I .52 7.72 

-J .07 8. 59 

-4.li 9.46 

•1.41 6. 10 

2.0** 
0.50 



-2.04 
1.01 
1.78 

qji4 
0.1s 



-1.45* 
1-28 
^.75 ft 
-1.67 0 ^ T 
-O.S9 



Low 

Lcwfcrtregs 
HI>jh»Aver«g« 

Tot«l 
r-T«it» fori 

»lA|.*i»» 
A t »»l» r » 



-4.80 -1.67 
-4.81 1.72 
2.21 3.H 
-4.06 
-2.80 

1.18 

2.S6 



ft 



-:.84 

1.97 
2.88 
•0.09 
1.11 



-4.21 
•5.15 
2.12 
-2.69 
-2.51 



1.S4 
2.68 
4.11 
-1.44 
2.27 



-9.41 
-10.0* 
■-7.58 
0.28 
-9.11 



-2.76 > 
1.04 
1.25 
0.15 
5,11. 



C 41 
2.69 
4.22 
-0.08 
2.19 



•10.06 
-9.71 
-0*91 

-16.61 
-0.49 



-9.84 , 
-14.75 
•19.19 
-41.69 
-14.96 



-1.46 
-0.-92 
2.v4 
•1.14 
•0.12 



4.19** 
2.02 



C.60 
1.S7 



0.89 



bow* A*«r 4*90 
Mlg».Aver*9e 
High 
TotAl 
r-Tttto fort 

Ai«8|Ai.« 



1.01 -1.54 

.0.98 1,46 

-1.20 4.11 

-1.69 10.06 

-0.79 1.17 

0.81 
1 18 



Low f 
Low- Average 
Mlgfc-Av«rage \ 
High 
T0t«l 
f-Ttste fori 

Ai«tU i4 f> 



1.12 
-2.92 
-:.6S 
.-4.09 
-2.30 



-6.42 
J. 96 
2.-J2 

-2.01 
1.16 



0.96 
1.S2 



/ 



Low 

Low Ave rage 
High* Ave re# 
High 
T0t«l 

r-T«tt« Jon 
b!ai,ai«»* 

Ai«8|»l.» 



-O.JO 
0.89 
J. 24 
4.09 
1-61 



-1.9J 
1.94 
9.44 

16.05 
6.4J 



6.21* 
2.21 



-J. 87 
1.61 
2.66 
J. 66 
1.S1 



4.J1 
•1.8J 
0.40 
1.S6 
0.36 



2.9S 
2.80 
2.06 
J. 07 
2.62 



-J. 70 
-6. J4 
-1.06 
1.06 
•4.J2 



-1.06 
-J.J4 
-0.26 
J. 46 
-0.84 



6.S7 
2 28 



o.ss 

0.66 



4.07 J.J7 

4.82 S.95 

4.*1 4.44 

-0.9J 10.08 

J. 82 S.75 

1.J8 
1 44 



•0. JJ 

20.27 
8. JO 
•0.57 



0.12 
0.12 
1.69 
2.89 
1.02 



-6.54 
1.J0 
"2.J8 
-5.85 
-0.J2 " 



J.J? 
-2.02 
•J.J* 

J. 09 
-0.8X 



-1.58 
0.67 
0.J0 

-2.58 

-0.22 



-0.J0 
-2.58 
•0.J9 
-7.70 
-1.94 



-0.0J 
-1.19 
-1.55 
-2.J2 
-1.41 



-4. Jl 
0.64 
J. 46 

-5.40 
0.09 



•4. SO 8.44 

1.84 * 8.68 

6.6jt> *5.0) 

-2.38 0.62 

1.04 6.9}, 



0.13 
5.18** 



0.49 
0.J4 



0.J1 
0.71 



-1.1) 
0.02 
0.25. 
-2.9.7 
-0.51 



•J. 92 

0.J4 
* 6.12 
11.00 
J. 52 



1.J6 
J. IS 
7.98 
9.60 
4.75 



.1.65 
4.11 
6.91 

11.C1 
5.95 



ij.22 
-5.42 
6.79 
S.26 
-2.10 



S.64 
4.19 
9.68 
11.18 
7.68 



6.S7** 
0.40 



4.JS** 
1.26 



■12. JS -1.J9 7.96 v 

-2.6J -1.J5 -1.99 

-1.7S 10.07 1.06 

J, 99 4.69 . 

-2.80 0.17 



2.2Jt 
0.85 



2.69 



1.45 
6.80 
10.55 
4.0) 



\he four cost levels for reading are defined In ter.. of the ~*n and stendard deviation U.d.l of the total resource cost of reeding 
Mrvicat for ell Ct students within grade as follows 1 Low - on* or sore s.d. below the »eani Low.Av«rage • xero to^n. s.d »>elow 
eero to one s.d. above the swani and High • one or wore s.d. *bov« tn* swsn. Th« low«r «nd j-Dint of ««ch 0 



Mrvlcos 

th« M4AI Mlgh-Av«r«9« 
l«v«7 i« «xciud«d fror* that l«v«l 

**r»r«tlo l» tl^r»lfle*nt *t th« ,01 l«v^. 

f T«st ls.not uniqu* Ucs'is* of th« wpty Coll. 
Not*. — SMpl* slxst *r« provided In T«bl« 0*14. 
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Tabic D-17 



Heah Reading Achievement Growth in Terms of vss scores* for Subgroups of CE Students Classified by 
Their Characteristics and by Four Levels of Stcndard-Resource-Dollar Cost in Reading 



C 
ft 

A • CCSt 

0 Level 

e (•>• 



Student Characteristics (Aj) 



Race/Ethnicity (Ai> 



White Minority 



Low x 

Low-Average 

High-Average 

High 

Totel . 
r-Tests for: 
»iAi»Ai><B 
Aj»B|Aj,B 



Low 

Low- Aver eg e 
High-Aver ege 
High 
Total 

r-Tests fort 
" b1ai.ai*b 

Ai*BjAi.B 



Low 

Low- Average 
High-Average 
High 
Total 

r-Tests for: 
B|A 4 .Ai«B 
lA i xB|A i .B 



' Low 
Low- Ave rage 
High-Average 
High 
Total 

r-Tests for: 
B]Ai»Ai*B 
AixB|Al.B 



Low 

Low- Average 
High-Avereg* 
High " 
Total 

r-Tetts for: 
BjAijAi-B 
a^bJaj.b 



54.4* 63.43 

53.50 63.84 

56.65 68.00 

54.10 59.86 

54.53 64.6) 

2.11 
0.45 



43.72 40.00 

48.01 43.56 

46.12 41.19 

44.51 35.92 

46.47 41.45 

2.77 
0.36 



32.51 30.21 

31.85 34.44 

37.70 35.72 

33.21 35.93 

33.73 34.46 



2.74 
1.12 



33.12 27. #4 

29.51 27.53 

30.63 33.93 

26". 58 39.26 

30.04 31.50 

1.74 
4.18** 



Free-Meals Program (A2) Seed for CE (A3) 



Love st Second Third Highest 



59.31 
58.67 
65.57 
'56.94 
60.47 



58.99* 

58.71 

57.36 

54.17 

57.67 



2.14 
1.89 



53.40 65.59 

57.38 61.05 

60.21 67.58 

54.65 60.85 

57.28 63.48 

2.56 
1.22 



42.26 
42.57 
41.26 
37.66 
41.56 



41.05 
50.31 
47.08 
45.01 
47.66 



2.97 
1.41 



41.54 42.20 

46.36 45.86 
43.53 46.01 

42.37 33.65 
44.35 44.45 

2.74 
0.84 



30.42 
34. C6 
35.90 
34.96 
34.21 



32.91 
31.51 
38.00 
33.64 
33.86 



3.09 
1.02 



34.06 28.68 

35.10 27.68 

37.32 33.19 

33.74 43.96 

35.43 29.42 

2.42 
2.08 



29.3b 
28.88 
33.09 
34.19 
31.12 



13.15 
28.29 
30.74 
29.98 
30.09 



1.26 
0.73 



32.43 29.58 

29.21 27.20 

31.72 34.69 

32.12 37.90 

30.97 29.68 

1.91 
0.66 



28.78 
25.44 
28.29 
27.39 
27.06 



16.62 
26.70 
26.65 
24.28 
25.50 



1.00 
2.19 



24.90 18.02 

25.74 21.43 

26.93 28.65 

27.99 34.29 

26.14 25.66 

4.69** 
2.29 



17.42 
25.53 
27.07 
21.28 
24.51 



31.51 
26,. 94 
28*03 
34.99 
29.05 



23.61 
26.32 
27.42 
26.06 
26.35 



28.00 
25.08 
27.48 
21.30 
26.01 



0.66 
4.21* 



0.27 
0.50 



20.77 
22.30 
27.62 
32.88 
?5.56 



25.34 
25.13 
28.44 
28.33 
26.39 



3.70 
0.90 



22.78 24.65 

23.62 22.93 

26.58 35.28 

31.21 33.42 

25.83 26.13 

4.45* 
# 1.19 



Low 

Low- Average 
High- Aver age 
High 
Total 
r-Tests tot 
B|Ai.Ai*B 

*i* B l A i« D | ' rntnl -n"»—~- cost of reading 

the Man! High- Average - zero to one s.d. aoove tne mean, 
level is excluded iron that level. 
Vratio is significant at the .01 level. 



Achievement Quartxle (A4) 



59.92 
62.48 
70.03 
63.46 
64.60 



60.66 
57.25 
60.77 
51.61 
57.56 



66.13 
59.60 
51.22 
43.52 
55.97 



49.44 
48.89 
48.57 
42.73 
48.56 



2.26 
2.24 



51,18 
51.34 
52.02 
47.78 
50.99 



36.18 
41.63 
35.26 
33.57 
37.87 



37.72 
44.80 
38.52 
38.22 
41.42 



31.07 
33.52 
28.03 
33.20 
31.70 



1.70 
0.64 



35.30 
38.64 
41.66 
39.85 
39.37 



34.01 22.47 

32.53 19.12 

33.86 22.36 

29.36 4.48 

32.71 19.09 

2.71 
1.81 



17.95 
13.36 
6.94 
-33.50 
12.54 



37.56 
32.44 
36.05 
40.28 
35.67 



25.89 
23.48 
22.45 
16.36 
22.38 



27.64 
26.46 
23.23 
22.69 
25.63 



18.58 
19.69 
43.70 
19.50 
21.77 



0.84 
1.43 



29.99 
29.10 
29.71 
29.09 
29.38 



19.23 17.21 

21.37 20.50 

23.64 22.51 

14.86 16.50 

20.95 19.90 

0.36 
0.63 



33.42 , 
29.31 ' 
10.25 
20.00 
28.53 



29.57 
26.51 
31.41 
34.93 
29.83 



13.93 2*. 90 

18.21 22.23 

18.06 30.05 

23.29 22. SO 

18.34 23.68 

0.71T 
0.52 



27.30 
18.75 
13.80 



59.19 
58.69 
62.36 
55.69 
59.30 



41.85 
46.22 
43.96 
41.60 
44.38 



31.53 
33.06 
36.80 
34.33 
34.06 



31.22 
28.62 
32.07 
32.64 
30.67 



25.16 
26.07 
27.43 
25.70 
26.30 



23.65 
23.42 
27.92 
31.39 
25.90 



f Test is not unique because of the empty cell. 
Note. - Sample sizes ere provided in Table D-14. 
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Ht«n Math Achievement Growth in Tint of Standardized (t) Scorer, for Subgroup* of CE student* Classified, by Their 
Characteristics end by Four Level* of Standard-Resource -Do liar Cost in Math 



Student Characteristics (Ai>' 



C 



X 

A COSt 
D Level 
C IB)* 


Race/ Ethnicity (A x > 


Free-Meals Program (A2) 


Need for ce (A3) 


Pretest Achievement Quartile (a 4 > 


White Minority 


Participant Non-Partic. 


Need No Need 


Lowest Second 


Third Highest Total 


N Mean N Mean 


N Mean N Mean 


N Mean N Mean 


n t Mean N Mean 


N Mean N Mean N Mean 


Low 

* Low-Average 
1 High- Ave rage 
High 
. Total 

r-Tests for: 

bJ Ai.Aj^B 
A^vB] Aj»B 


103 -0.21 58 -0.17 
27S -O.IS 3*1 0.16 
168 -0.08 2S1 0.17 
46 0.06 113 ,0.16 
592 -0.12 816 0.14 

3.27 
1. 18 


77 -0.18 84 -0.21 
432 0.08 237 -0.06 
265 0.08 154 0.05 
124 0.14 35 0.10 
898 0.07 510 -0.04 

3.89** 
0.40 


55 -0.10 106 -0.25 
347 0.14 322 -0.08 
283 0.06 136 0.09 
124 0.15 35 0.08 
809 0.09 599 -0.06 

3.08 
1 .50 


44 0.34 38 -0.19 
272 0.39 193 -0.02 
174 0.46 126 -0.01 

97 0.33 39 -0.26 
587 0.40 396 -0.06 

1 
1 


46 -0.34 33 -0.71 161 -0.19 
110 -0.12 94 -0.71 669 0.03 
74 -0.21 45 -0.77 419 0.07 
15 0.01 8 -0.11 159 0.13 
245 -0.18 180 -0.70 1,408 0.03 

33 
15 


Low 

Low- Ave rage 
2 High-Average 
High 
Total 
r-Tests for: 
b|ai,aixb 


90 -0.06 58 -0.07 
398 0.01 366 0.00 
167 0.10 ■ 250 -0.07 
'-81 -0.10 134 -0.01 
736 0.01 808 -0.03 

0.71 " 


101 -0.09 47 -0.01 
469 -0.01 295 0.03 
270 -0.02 147 0.04 
148 -0.05 67 -0.03 
988 -0.03 556 0.02 

0.41 


60 -0.09 88 -0.05 
418 -0.00 346 0.02 
285 -0.01 132 0.02 
170 -0:08 45 0.09 
933 -0.02 611 0.02 

0.42 


50 0.29 42 -OV09 
309 0.29 223 0.01 
191 0.21 121 -0.03 
107 0.25 61 -0.23 
657 0.26 44V -0.05 

0 
O 


29 -0.30 27 -0.43 148 -0.07 
123 -0.29 109 -0.46 764 0.01 

48 -0.10 57 -0.55 417 -0.00 

30 -0.46 17 -0.43 215 -0.04 
230 -0.27 210 -0.47 1.544 -0.01 

82 
92 


Low 

Low-Average 
3 High- Average 
High 
Total 
F-TestS for: 

b|ai,aixb 

A^*b1 A^ , B 


86 0.11 80 0.03 
356 -0.05 395 0.15 
172 0.11 239 0.14 

97 0.07 130 -0.07 
711 0.03 844 0.10 

1.46 
4. 15** 


102 0.03 64 0.13 
439 0.10 312 -0.01 
268 0.13 143 0.13 
154 -0.05 73 0.08 
963 0.08 592 0.05 

1.29 
1 .76 


76 0.08 90 0.06 
435 0.07 316 0.03 
337 0.11 74 0.22 
202 0.01 25 -0.15 
1.050 0.07 505 0.06 

2.41 
0.96 


80 0.19 46 0.09 
319 0.26 220 -0.01 
227 0.26 111 0.04 
129 0.21 55 -0.18 
755 0.24 432 -0.01 

2 
1 


26 0.08 14 -0.69 166 0.07 
141 -Q.14 71 -0.28 751 0.06 
58 -0.15 15 -0.18 411 0.13 
30 -0.32 13 -0.63 227 -0.01 
255 -0.14 113 -0.36 1.555 0.07 

66 
19 


Low 

Low-Average 
4 High-Average 
High . 
Total 
r-Tests for: 

B|Ai,Ai*B 
Ai*B) Ai < B 


71 -0.02 39 -0.31 
390 -0.02 332 -0.07 
164 0.02 182 -0.05 

74 0.09 107 0.33 
699 0.00 660 -0.01 

8.85** 


60 -0.23 50 0.02 
404 -0.08 318 0.00 
196 0.02 150 -0.07 
130 0.19 51 0.34 
790 -0.02 569 0.02 

9.55*** 
c» 2.44 


43 -0.13 67 -0.12 
469 0.01 253 -0.14 
244 0.10 102 -0.30 
161 0.23 20 0.30 
•17 0.06 442 -0.15 

6.24** 
4.32** 


34 -0.03 32 0.02 
329 0.15 212 -0.09 
174 0.22 96 -0.05 
118 0.33 43 *0.14 
655 0.19 383 -p. 04 
+ 

3. 
1. 


26 -0.06 18 -0.63 110 -0.12 
110 -0.27 71 -0.47 722 -0.04 
55 -0.49 21 -0.59 346 -0.01 
13 -0.17 7 -0.09 181 0.23 
^204 -0.29 117 -0.49 1,359 -0.01 

07 
82 


LOW 

Low- Ave rage 
5 High- Ave rage 

High 

Total 
• r-Tests for* 

BjA i# Ai*B 
A£x&| Ai", B 


95 -0.07 28 -0.02 
319 0.06 337 0.07 
140 0.11 218 0.02 

51 0Sl6 124 0.09 
60S 0.06 707 0.06 

. 1.35 
0.71 


55 -0.03 68 -0.08 
412 0.05 244 0.09 
239 0.05 119 0.06 
142 0.10 33 0.15 
848 0.06 "* 464 0.06 

1.92 
0.20 


65 -0.06 58 -0.06 
484 0.09 172 0.01 
278 0.09 80 -0.05 
154 0.14 21 -0.12 
981 0.09 331 -0.03 

1.04 
0.81 


44 0.05 26 -0.O7 
365 0.23 165 -0.02 
200 0.20 83 -0.09 
125 0.18 36 0.01 
734 0.20 310 -0.04 

0 
0 


42 -0.13 11 -0.20 123 -0.06 
83 -0.21 43 -0.515 656 0.07 
53 -0.08 22 -0.35 358 0.06 
12 -0.23 2 -0.65 175 0.11 
190 -0.15 78 -0.39 1,312 0.06 

26 
93 


Low 

Low- Ave rage 
& High-Average 
High 
Total 
r-Testo for: 

b)ai,ai*b 

Ai»B|Ai # B 


96 -0. 10 22 0.09 
416 0.04 383 0.04 
154 -0.02 161 -0.01 

69 0.13 136 0.23 
73S 0.02 702 0.07 

4.33** 
0.66 


56 -0.05 62 -0.08 
456 0.06 343 0.01 
189 0.C2 126 -0.07 
138. 0.21 67 0.16 
839 0.07 598 0.00 

5.78** 
0.09 


54 -0.20 64 0.06 
474 0.07 325 0.00 
225 0.01 90 -0.07 
171 0.23 34 0.04 
924 0.07 513 -0.00 

3.. 

3.06 


50 0.13 39 -0.14 
423 0.16 193 0.03 
168 0.16 90 -0.13 
131 0.34 44 -0.04 
772 0.19 366 -0.03 

1 
1 


20 -0.23 9 -0.40 118 -0.06 
130 -0.17 53 -0.38 799 0.04 
44 -0.36 13 -0.29 315 -0.01 
24 -0.10 6 -0.13 205 0.20 
218 -0.20 81 -0.35 1.437 0.04 

71 <fc 
04 r 
1 



The four cost-levels for math are defined in terms of the mean and standard deviation (s.d.) of tha total resource cost of math services for 

all CZ students wtihin each grade as follows: Low - one or more e.d. below the mean) Low-Average - zero to one e.d. below the meam High-Average - 

z*ro to o«« s.d. abova the mean) and High - one or more s.d.- above the mean. The lower end point of each level is excluded from that level. 



significant at the .01 level. 
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M«*n-M*th Achievement Growth in Terms of Residual Gain Score* Based on the Estimated Regression 
Using Data From Mon-CE Students Attending Non-CE Schools, for Subgroups of CE Stw*- Classified 
By Their Characteristics and by Four Level* of Standard-Resource-Dollar "^st in H«h 



Student Charecteristics <Ai> 



Cost 
Level 
<B>* 



Race/Ethnicity <Ai> 



White Hinority 



tow 


-3.85 


-1.37 


Low-Average 


•3.34 


IS. SO 


High-Average 


0.17 


18.68 


High 


-5.7? 


12.85 


Total 


-2.62 


14.91 


F-Tests for: 






B|Ai.A|xB 


4.27 




Ai»B|A|,B c 


2.25 





Free-Meals Program <A2> Heed for CF (A3) 



Participant 



Non- 
Participant 



Need No Need 



-1.77 
10.82 
1S.S9 
8.79 
10.87 



-4.0S 
2.17 
3.80 
2.74 
1.68 



4.50* 
0.69 



6.17 -7.69 

M.O82 0.95 

14.69 4.12 

11.05 -5.26 

13.29 -0.22 

3.21 
0.21 



Achievement Ojuartil© 1*4) 



Lowest Second Third Highest 



4.68 
7.65 
11.61 
3.72 
7.95 



-7.42 -5.54 

7.24 14.17 

8.52 17.37 

-0.0S 31.71 

5.52 12.51 

8.22" 
2.29 



-4.40 
1.61 
7.53 

44.06 
3.88 



-2.96 
7.76 

11.26 
7.4*6 
7.54 



, LOW o 
Low- Aver age 
High- Aver age 
High 
Total 

F-Teats for: 
B|Ai.Ai»B 

ai»b|ai,b 



-4.43 
1.12 
2.62 



2.99 
2.04 
1.38 
3.93 
2.22 



-1.91 
0.04 
1.67 
0.42 
0.34 



-0.69 
3.98 
2.25 

•1.95 
2.42 



-0.82 
2.06 
1.41 

•2.53 
0.84 



-2.00 
0.96 
2.87 
8.02 
1.47 



3.85 
1.22 
-0.53 



-5.31 
3.59 
3.45 

-5.72 
1.45 



•7.35 
-1.12 
9.08 
-6.45 
-0 47 



0.69 
1.41 
0.51 



-1.52 
1.56 
1.87 

-0.32 
1.09 



0.61 
1.58 



0.52 
0.42 



1.01 



1.08 



Low 

low- Average 
High-Average 
High 
Total 

F-Tests for; 
B{Ai,Ai»B 



•2.79 
-3.92 
5.31 
7.20 
H).03 



6.44 
17.93 
18.92 
10.69 
16.00 



3.02 
12.83 
14.86. 

8.86 
11.72 



-0.52 
0.18 

10.16 
9.91 
3.71 



12.74 -7 70 

\6.02 -4.06 

15.83 1.35 

10.79 -3 70 

14.72 3.90 

0.84 
0.40 



5.32 
9.35 
13.72 
12.79 
10.83 



2.72 9.73 

10.61 3.75 

13.20 12.54 

6.90 5.11 

9.96 6.52 

^ 3.81** 
1.14 



-37.79 
-2.26 
8.51 
-7.30 
-5.81 



1.66 
7.57 
13.22 
9.20 
8.67 



Low 

Low -Ave rage 
High-Average 
High 
Total 

F-Tests fori 
BjA£,AixB 
Al»B|Ai.B 



-4.27 
-4.08 
-2.46 
0.32 
-3.25 



-9.10 
-4.45 
-2.92 

17.6? 
-0.72 



4.83" 

2.11 



Low 

Low-Average 
High- Ave rage 
High 
Total 

F-Tests for: 
BiAi„Ai»B 

a 1 >«b|a 1 .b 



-5.96 
0.41 
4.28 
0.46 
0.31 



13.89 
8.83 
5.06 
4.91 
7.18 



a. 09 

1. 31 



-10.22 
-7.02 
-0.52 
7.37 
-3.28 



-0.89 
-0.74 
•5.55 
18.76 
-0.27 



-10.47 
-0.43 
5.60 
10.65 
2.65 



-3.10 
-11.33 
-22. *7 
9.93 
-11.71 



0.75 
8.37 
-1.85 



1.79 
-1 95 

1.64 
17.67 

1.46 



9.65 
-0.67 

-rs.i? 

0.11 
-2.82 



-22.73 
-11.41 
-18 65 
12.40 
-13.02 



-5.98 
-4.2S 
-2.70 
10.5b 
-2.02 



6.69" 
1.90 



3.76 
5.64* 



3.30 
1.65 



5.42 
6.56 
5.68 
3.53 
5.73 



-6.98 
1.67 
2.89 
3.95 
0.87 



8.28 
6.85 



-2.66 
-1.16 
-7.49 
-20.15 
-4.16 



-8.90 
5.48 
3.87 
1. 35 
3.47 



1.71 
8.61 

5.04 
12.03 
7.47 



1 98 
-1.27 
9.16 
1.54 
2.54 



7.93 
-4.83 
1.05 



-1.44 
4.74 
4.75 
3.61 
4.01 



0.47 
0.50 



1.23 
1.72 



Low 

Low- Ave rage 
r High-Ayerage 
High 
Total 
F-Tests for: 

Ai»8|Ai,B 



-10.17 
-1.13 
-6.09 
6.00 
-2.68 



13.33 
12.28 
5 75 
20.34 
12.38 



0.68 
11.90 

5.99 
18.42 
10.89 



-9 09 
9.S5 
-4.05 



-11.28 
10.14 

3.71 
17.78 

8.73 



-1.16 
-1 77 
-9.41 
4.14 
-2.64 



2.37 
' 5.83 

4.77 
20.33 

7.84 



-3.37 
6.03 
2.56 



-9.94 
8.92 



-12.05 
-3.83 
-5.76 
6.43 
-4.29 



-0.04 
15.52 
4.67 



0.33 



6.06* 
0.28 



2.17 



0.74 



The four cost-levels for nath are defined in terns of the mean and standard deviation Is.d.) of the total resource cost of math 

services for ell CE students within each grade as follows. Low - one or more s d. below the mean* Low-Average » zero to one s.d. below 

the mean* High-Average - zero to one s.d. above the mean* and High - one or rore s.d above the mean The lower end point of each 

level is excluded from that level. 

F-ratio is significant at the .01 level. 

Note. — Sample sizes are provided in Table D-18. 
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T*ble D-20 

Mean Math Achievement Growth in Terms of Residual Cain Scores Based on the Estimated Regression Using Data 
from Non-CE Students Attending CS Schools* for Subgroup! of Ct Students Classified by 
Their Characteristics and by Four Levels of Standard-Re source-Dollar Cost in Math 



Student Characteristics <Aj) 



It 

A Cost Race/Ethnicity 


Free-Meals Program <A2> Need for CE <A3> 


Achievement Quart lie <M> 
Totti 


D Level 

E White Kinority 


Participant part ^ nt Need No Need 


Lowest Second Third Highest 


Low *6.25 "8-<7 
Low-Average -5.72 6.55 
1 High-Average -1.22 10.27 
High -8.51 4.20 
Total -4.75 6.30 
r-Tests fori 

B j Ai,Ai"B 4.37 s * 
Ai»BjAi,B 1.78 


-7.40 -6.74 0.64 -11.05 
' 3.28 -1.72 7.01 -4.43 
8.04 1.58 8.61 -0.47 
0.86 -0.67 4.04 -11.94 
3.43 -1.48 6.68 -5.14 
\ 

4.18" 3.08 
0.44 0.28 


-1.65 -9.32 -6.46 -12.47 -7.05 
0.33 3.39 9.40 -8.20 1.51 
6.21 5.13 11.19 -4.05 5.66 

-3.48 -4.24 24.28 27.75 0.53 
1.30 1.97 /.87 -6.34 1.65 

5.85" 
1.88 


Low -7.11 -5.20 
Low-Average 1.51 -6.37 
2 High-Average 3.29 -5.79 
High -5.52 -4.67 
Total 0.06 -5.83 
r-Tests for: 
B|*i,Ai«B "■ 0.81 
Ai»B| Ai ,8 1.34 


-7.10 -5.17 -3.96 -8.21 
-5.78 3.32 0.56 -5.69 
-4.45 2.06 -2.23 -1.98 
-6.24 -2.23 -5.71 -2.30 
-5.62 1.60 -1.72 -5.00 

0.81 0.41 
0.44 0.93 


-7.21 -9.55 "8.73 2.04 -6.49 
•7.40 1.49 0.69 1.27 -2.27 
-12.36 0.42 12.03 14.64 -2.15 
-7.94 -6.78 -2.37 15.36 -4.99 
-8.92 -0.96 1.47 6.14 -3.02 

2.05 
1.68 


Low . -6.80 -8.30 
Low-Average -9.96 0.90 
3 Hlgh-Averace -3.56 -0.81 
High -5.23 -10.85 
Total -7.38 -2.27 
r-Ttsts for: 
-b|Ai,AikB 1.43 
A 1 m8)A 1 ,B 3.35 


-9.10 -4.99 -4.96 -9.68 
-2.75 -6.36 -2.80 -6.25 
-3.46 0.85 -2.18 -0.95 
-10.92 -3.24 -7.75 -14.06 
-4.93 -4.08 -3.71 -6.47 

1.36 1.55 
1.66 0.33 


-7.73 -4.45 1-49 -33.16 -7.52 
-4.23 -4 .43 -4 . 65 -2 . 99 -4 . 25 
-2.41 -2.16 - -0.68 1.46 -1.96 
-6.20 -11.70 -8.66 -16.53 -8.45 
-4.39 -4.77 -3.59 -7.70 -4.61 

2.44 

0.97 


% Low -7.08 -11.68 
Low-Avtrage -8.39 -9.34 

4 High-Average -6.75 -9.31 
High -4.55 11.05 
Total -7.47 -6.17 

r-Ttsts for: 
B|Ai,AimB. 3.85*' 
Al*»|Al,B\ 2.09 


-13.14 -3.40 -19.44 -1.83 

-1U.74 0.13 ~7mHV I .03 

-5.89 -10.99 -3.66 -18.72 
2.71 9.68 3.50 14.11 
-7.61 -5.76 -6.11 -8.34 

4.95" 4.23" 
1.40 4.78** 


-17.85 -5.39 7.14 -20.23 -8.71 
-6.34 -12.55 -9.38 -8.40 -8.83 
-1.22 -10.27 -23.84 -14.01 -8.10 
6.76 1.99 -7.26 8.13 4.67 
-3.22 -9.75 -11.04 -10.23 -6.84 

1.86 

\ 1.85 


Low -11. 12 1 7.25 
Low- Average -1.63 6.14 
5 High-Average 2.47 2.84 
High 0.88 3.19 
Total -1.96 4.65 

r-Tests for: 
bIai,Ai*B 0.27 
A| m B{A| <B 1.24 


0.17 -12.69 -4.01 -10.23 
4.20 -0.74 5.11 -5.36 
3.75 0.58 6.64 -11.02 
1.83 5.49 5.88 -22.15 
3.42 -1.71 5.06 -8.65 

1.39 1-39 
0.72 1-38 


-9^60 -4,92 -6.89 -1.30 -6.94 
5.20 3.82 -6.69 -9.83 2.36 
3.23 1.12 6.15 -4.59 2.69 
0.77 9.89 -0.90 -0.54 2.52 
3.02 3.07 -2.79 -6.91 1.60 

0.65 
Q.77 


Low -7.81 2.94 
Low .'erage 0.87 7.84 
6 High-Average '0.44 4.06 
High I 8.73 21.84 
Total 1 0v20 9-53 

F-TtJts for- 
bIai.A^B 4.25" 
A^BiAjl.B 0.38 


-2.68" -8.63 -14.35 1.40 
9.03 -2.19 8.00 -1.32 
6.90 -5.71 4.85 -5.62 

19.92 12.29 19.60 6.49 
9.56 -1.98 8.07 -1.22 

6.54" 3.93" 
0.23 2.85 


0.35 -11.17 -10.31 -6.76 -5.81 
6.78 3.63 -0.16 " -3.46 4.21 
9.74 -5.74 -12.46 1.05 1-86 
24.35 3.57 6.68 10.84 17.43 
9.99 -0.26 -2.82 -2.04 4.76 

2.14 
0.86 



*The four cost- levels for math are defined in terms of the mean and standard deviation (s.d.) 
services for all CE students within each grade as follows* Low - one or more s.d. below the 
the mean- High- Average • zero to one s d. above the meant and High - one or more s.d. above 
level is excluded from that level, 
"r-ratio is significant at the .01 level. 
Hot©. — Sample sizes are provided in Table 0-18. 



of the total resource cost of math 
1 me An; Low-Average - zero to one s.d. below 
the aetn. The lower end point of each 



SamjpL 



414 



:RLC 



389 



, fa , Table D-21 

H..n Hath Achi.v^nt Growth in Term, of VSS Scow,, for Subgroup, of CE Student. CUs.ified by Their 
Characteristics and by Four Uvtls of Standard-Resouxce-Dollar Cost in Hath 



Student Characteristics (Aj) 



Cost 
Uvtl 



Race/Ethnicity rree-Hsals Program (A2> Need forCE(M> 



White Minority 



Low 

Low-Average 
High- Average 
High 
total 

F-Tests fors 
B|Ai.Ai»B 
Al»B|A lt B 



54. 8d 
53.48 
55.81 
55.00 
54.50 



49.47 
65.27 
64.76 
61.50 
63.47 



1.84 
2.19 



Lov 

Low- Aver age 
High* Average 
High 
total 
F-Test» fort 

*Ui.Ai*B 

ai*bJaj.b 



51.29 
54.89 
57.83 
46.80 
54.23 



49.53 
52.87 
48.88 
52.62 
51.36 



0.79 
1.63 



Hon* 

Participant p „ tlclpwt 



Need Ho Need 



49.55 
61.25 
60.70 
59.88 
59.89 



56.04 
58.92 
61.99 
58.69 
59.35 



51.62 
61.07 
59.00 
59.50 
59.46 



53.61 
59.72 
65.71 
60.03 
60.02 



2.08 
0.65 



2.38 
0.92 



48.68 
52.35 
51.16 
49.96 
51.29 



54.72 
56.42 
54,87 
51.46 
55.27 



0.52 
0.09 



46.30 53.53 

50.81 57.68 

49.87 58.08 

47.19 62.67 

49.57 57.54 

0.53 
0.48 



Low 

jtiw- Ave rage 
I igh-Averege 
High 
Tot*l 

r-Tests for: 
B|Ai.Ai«B 

v»tv» 

Low 

!>ow- Average 
Hi<ih- Average 
High 
total 

f -Tests fors 
B|Ai.AixB 
Aj K B|Ai.B 
Low 

Low-Avera5e 
High- Ave rage 
High 
Total 
F- Tests for: 

b)ai.ai*b 
a^bIai.b 



57.76 
54.05 
S9.60 
55.73 
56.07 



49.63 
54.11 
53.83 
43.07 
51.90 



1.52 
1.64 



48.65 
47.74 
50.23 
52.62 
48.93 



33.72 
43.80 
45.16 
69.07 
47.68 



6.27*' 
3.46 



50.84 
52.52 
53.38 
44.98 
51.38 



58.61 
56..2B 
61.62 
55.86 
57.77 



1.31 
0.53 



55.03 52.83 

52.97 55.62 

54.37 64.77 

49.38 41.20 
52.88 55.75 

2.74 
1.43 



Achievement fertile (A4) 



Lowest Second Third Highest 



65.68 
67.90 
70.99 
63.73 
67.96 



49.92 
58.16 
58.24 
45.59 
56.16 



52.02 
61.11 
56.64 
65.40 
58.31 



40.67 
42.64 
38.91 
67.25 
42.44 



1.19, 
1.16 



61.62 48.26 42.10 42.96 

61.66 53.70 43.89 43.76 

56.70 51.04 54.13 39.91 

60.62 41.23 35.77 45.18 

60.05 50.77 44.74 42.73 



0.69 
1.00 



60.44 58.41 

62.42 52.35 

61.72 52.77 

57.36 40.75 

61.13 51.63 



54.35 
46.21 
46.38 
37.40 
46.04 



0.14 
37.63 
37.27 
18.69 
30.76 



3.03 
1.56 



36.30 
43.06 
49.08 
59.52 
46.75 



51.82 
'49.57 
45.59 
69.57 
50.51 



7.36* 
1.76 



38.00 46.79 

47.74 42.56 

53.60 33.13 

61.53 68.90 

51.2? 42.21 

5.09" 
4.04»» 



41.38 52.88 54.85 13.56 
53.37 44.69 40.59 23.37 

58.39 -46.41 27.36 16.14 
59.56 44.46 45.71 
47.48 39.09 21.90 



66.32 
56.42 



2.44 

1.67 



52.93 
60.42 
61.17 
59.62 
59.70 



50.60 
53.92 
52.47 
50.43 
52.72 



53.84 
54.08 
56.25 
48.48 
53.81 



43.35 
45.93 
47.57 
62.35 
48.32 



37.39 
44.98 
50.07 
47.20 
45.16 



39.82 
42.88 
37.19 
41.69 
40.79 



38.56 
41.98 
40.56 
41.68 
41.31 



37.44 
47.15 
45.56 
50.27 
•45.54 



0.39 
1.32 



0.85 
0.25 



34.75 41.52 

43.94 43.78 

43.55 37.63 

45.26 28.90 

43.43 40.95 

0.97 
1.26 



40.05 37.19 35.98 38.82 

52.21 40.01 26.54 21.86 

49.58 35.24 31.87 26.73 

46.84 39.39 23.17 13.00 

49.85 38.42 29.90 25.40 



0.22 
0.74 



Low 

Low- Ave rage ' 
High-Average 
High 
Total 
F-Te*ts for: 
B|A I .A i »B 
A^BlAi.B 



32.54 
42.00 
36.21 
48.71 
40.18 



43.73 
40.82 
36.96 
54.69 
42.71 



4. 29* 
0.61 



35.36 
42.06 
38.63 
53.5) 
42.73 



33.97 
40.60 
13.54 
50.96 
39.58 



44.66 
^1.59 



5.45* 
0.12 



22.74 
41.33 

37.09 "15.36 
53.95 46.29 
41.54 41.19 

3.34 



46.14 
47.62 
47.13 
62.59 
49.96 



26.44 

37.75 
26.90 
32.43 
33.24 



26 35 
32.51 
17.59 
37.29 
29.46 



24.56 
2'. 36 
31 92 
46.33 
29.19 



2.43 



1.70 
0.96 



37.94 
43.90 
42.23 
43.30 
42.81 



34.63 
41.43 
36.59 
52.68 
41.42 



'the four cost-levels for math are defined in terms of the 
services for all CE students within eech grade es follows 
the -earn High-Average - «ro to one s.d. above the mean, 
level la excluded frcsi that level. 
**F-ratio is significant at the .01 level. 
Note. — Sample sizes ere provided in Table 0-18. 



«e»n and standard deviation U.d.) of the total resource cost of math 
: iow - om or more s.d. below the mean. ^-J"*"?!/ *»° " ^..cb 
and High - one or more s.d. above the me.n. The lower end point of each 



1 r 



ERLC 



390 



} 



t Math 
Cost 
Levels* 



Table D-22 

Average Residual-Gains in Practical Achievement iot CE Students by Four Levels of 
StaiKSard-Re source-Dollar Cost in Reading and in Hath 



Grade 4 



Reading Cost Levels* 



tow 



Low High 
Average Average 



High 



Total 



Grade 5 



Reading Cost Levels* 



Low High 
Average Average 



High 



Total 



Grade 6 



Reading Cost Levels* 



•Low - *«" High 
Average Average y 



Total 



Low 

Low Average 
High Average 
High 
Total 



Low 

Low Average 
High Average 
,High 
Total 



136 
-0.75 

298 
-0.12 

42 
-0.91 

9 

-0.34 

485 
-0.37 



-0.78 
-0.07 
-0.55 
-0. 23 
-0.31 



Mean Residual Gain Scores Based on the 
(Sample sizes are provided in 



169 
-0.81 

5b2 
-0.55 

153 
-0.22 



16 
0.12 



67 
-0.73 

328 
-0.52 

182 
0.24 

65 
-0.04 

642 
-0.28 



52 
0.41 

135 
-0.61 

63 
0.09 



Estimated Regression Using Data from the Non-CE Students Attending Non-CE Schools 
the first row for each math cost-level, and omitted in the lower section) 



108 
1.52 

920 642 . 358 
-0.53 -0.28 0.31 

Mean Residual Gain Scores Based on t. 

-0.76 -0.62 0.11 -0.64 

-0.45 -0.65 -0.77 -0.44 

-0.19 0.02- 0.06 -0. 10 

-0.08 -0.18 1.66 0.83 

-0.46 -0.41 0.24 -0.31 



424 


152 


187 


81 


25 


445 


-0.63 


-0.07 


0.00 


0.69 


-0.73 


0.06 


1,343 


171 


554 


308 


84 


1,117 


-0.45 


0.13 


0.23 


-0.21 


0.67 


0.13 


440 


38 


207 


157 


100 


502 


-0.05 


0.97 


-0.14 


0.19 


0.21 


0.12 


198 


18 


43 


45 


93 


199 


0.81 


-0.34 


-1.43 


-0.06 


-1.63 


-1.11 


2 , 405^ 


379 


991 


591 


302 


2,263 


-0.31 


0.11 


0.04 


0.03 


-0.30 


0.01 



92 


89 


54 


4 


"239 


-0.28 


1.05 


0.84 


4.47 


0.55 


225 


697 


308 


119 


1,349 


0.70 


1.05 


1.08 


0.56 


0.95 


45 


190 


132 


73 


440 


0.39 


1.81 


1.39 


1.71 


1.52 


13 


43 


89 


114 


259 


0.89 


1.20 


0.56 


1.38 


1.04 


375* 


1,019 


583 


310 


2,287 


0.43 


1.20 


1.05 


1.18 


1.03 



.e Estimated Regression Using Data from Non-CE Students Attending CE Schools 



-0.80 
-0.62 
-0.32 
-1.66 
-0.71 



-1.08 
-0.53 
-0.63 
-2.32 
-0.73 



-0.80 
-1.12 
-0.71 
-0.52 
-0.92 



-2.11 
-0.51 
-0.54 
-2.30 
-1.20 



-0.99 
-0.70 
-0.61 
-1.84 
-0.84 



-0.59 
0.18 
-0.12 
0.55 
-0.04 



0.20 
0.08 
0.93 
0.28 
0.26 



-0.77 
-0.02 
0.12 
-0.55 
-0.14 



1*38 
-0.27 
0.53 
-0.19 
-0.03 



-0.31 
0.04 
0.51 
-0.20 
0.07 



wrvfces* ror^r^SLn^^^ "3 de£i ; ed , in teis of the Zander* deviation (s.d.) of the total resource costs of reading/math 

2?£ llLltl ^udents within each grade as follows: Low - one or more s.d. below the mean; Low-Average - zero to one s.d. below the mean; 

52 iZl 9 OIie ^ ^ Hi9h " ° nC ° r n ° re S ' d * ^ VC the nean ' The low " ^ * each Telel ls exuded from 
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on th« e*tl»*t*d Regre**lon 
y*ing &*t* Frop Non-CE Student » 
Attending Son-CE Schools 



M«*n R**idual <5*in Scot** 8*i»d 

on the E*tU*t*d Regre«*ion 
U*lng Dete Fr©» Non-CE Student* 
Attending CE School* 
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Cr*4* 4 
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■I* ■».» ■»•• ■*•» •* '•• 



Figure D- 1 



Averege fell-to-Spring C«in* Ivertical Axis) in Reeding for CE Student* by UveU of Reeding Service Co*t* 
(Korlxofitel Axl«* Indexed by Kvwber of Standard Devietion* Away Fro* the Mtan Co»t*) 

Not*. — feafcer* of ce*es on which seen* ere be*ed cen be found in Teble 0-4. 
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*••» Gain* U 'Hem* of 
StAMMdlMd (t) »oor*« 



Xeen fe*ldu*l C*ln Score* B**ed 

on th« S*tlMt*d R*?r**»lon 
Uelng 04t* rroa Non-CS Student* 
Attendlrg Non-Ct School* 



H« An R«ildu*l Cain Score* &***d 

on th« E«tin*ted R*o.r*ttion 
Uelng Oet* Fro* Non-CE Student* 
Attending CZ School* 























Cr«d« 4 
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Av.,.o. r.ll-to-Sprin, Cln. (V««ic.l A.1.) in Ittth for CC S.ud.nt. by Lav.l. of Co.t. 
(Jorl«nt.l lit: lnd.»d by »-o.r of st«<Urd cvLtlon. »~y rro. th. H.™ co.t.) 

Not.. - ■*■*«• of cimi on -hlch MWt *K bnMd c.n be found In T*bl. D-«. 
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iml of Service Coata (Midpoint Indeaed by 
Mater of Standard Aviations Away Tram the 
Han Co»t» {or ell C£ Studants) 



Title X Students in Titla X School* •••••• 

Other-Ct studeate in Tttl* X School* 
Other-Ct Students in Owher-Ct Schools mm—m— 
Moody Hoo-CS Students in Mon-Ct Schools ooooooo o 
Woody Non-Ct Students in CX Schools ■ 



1 1 



i 




.10 
.00 
-.10 
-.20 
-.30 
-.40 
-.50 
•.SO 




-1.5 -0.5 0.5 



.10 



1.5 • 
.** 




-1.5 -0.5 0.5 1.5 



Avere?e r*ll-to-Sprinq S-Score Cains (Vertical Axle) for the Three Groups of C£ itudents and Two Groups of 
Needy Boo-CE Students, by Levels of Service Costs (Horizontal Axis) 

Note. — Nuaoers of esses on which mens «re based can be found in Tablaa 0*8 and D-10. Means based on fswer than' 
five cases are not plotted. 
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l«v«l of Ssrvic* Costs (Midpoint XndsKOd by 
Muobsr of Standard Deviations Away rro» ths 
Hssn Costs for all CZ Students) 
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T< is 1 Stirtanta In tltla 1 Schools •••••• 

0U«r-CE Students In Tltls I Schools «••••• 
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f Hur« D-4 



Av^r»« Mtidual C*in. Sated o-- Enptetod Po.ttm Seora CttlMted With Data for Hon-Ct Student! 
*S C3R«££ "artie.1 *>r the Croup, cf ^ °' 

needy non-CI students, by Levels of Service Cosvs inorijontai Axis).. 
K0f. - of case, on «.ith w ,r. U«4 csn be f«»d in T»la« and D-10. Ke.na 

besed on fever than five c*m* are not plotted. 
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rigure 0-5^ 

Av.r.** Re.idual Calm Bated on Expected Po.ttett Score CttUated With Data for Non-CE Students 
Attending CE School* (Vertical Axis) for the Three Croupe of CE Studente *~* Groups of 
Needy Mon-Ct Student*, by Levelt of Service Coata (Horizontal Axi*). 
Note. - »u»b*r* of Ca»*a on which lean* ere baaed can be found in Table 0-8 and D-10. Meant 
bated on fever than five cage* are not plotted. 
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Table B-l 



-Indicators of Fall-to-Spring Reading Achievement Growth for CE Students and 
* Two Comparison Groups of Non-CE Students Judged to be in Need of Reading CE 



Reading 
CE Students and 
Comparison Groups* 

Selection /School 



Keaii -T, Gem as 
a Percentage of 
that Required to 
Maintain the 50th 
Percentile Rank 



Average 
Pretest 
Percentile 
Score 



Average 
Posttest 
Percentile 
Score 



Mean Posttest^Score 
as a Pd^cjy^gejc^f ■ 
the Expetfc£tf^R£an 
Estimated With'^ 



Model A** Model B** 





Title I/Title I 


'89.1 


29.7 


30.4 


101.8 


100.1 








40,7 


39.7 


99.4 


99.0 


1 


Other-CE/Other-CE - 


81.5 


40.4 


35.0 


98.6 


98.5 




Needy Non-CE/CE 


82.5 


29.5 


27.6 


1C x .9 


99.9 


• 


Needy Non-CE/Non-CE 


79.4 


28.8 


25.2 


10 M 


99.3 




«? 

Title iAitle-I 


91.8 


25.6 


26.4 


99.9 


no i 




v/cner v.e</ iiuic x 


88. 8 


41.5 


y 4o.o 


99.7 


99.6 


2 


Other-CE/Other-CE • 


98.8 


29.9 


32.2 


100.6 


100.7 




Needy Non-CE/CE » 


85.6 


26.6 


25.9 


100.2 


100.6 




Needy Non-CE/Non-CE 


82.6 


24.1 


22.4 


99.3 


99.9 




Title I/Title I 


*102.3 


22.6 


24,6 * 


99.8 


100.2 




Utner*tL/ ntie * 


88. 6 


37.1 


• 37.0 


98.9 


99.1 


3 


Othe r-CE /Othe r- CE 


100.1 


30.0 


30.7 . 


99.2 


99.7 




N*»edv Non— CE/CE 


i8.8 


25.8 . 


27.3 


100.6 


100.8 




Needy Non— CE/fclon-CE 


85.4 


23.1 


22.4 


99.7 


100.1 




Title iAitle I 


106.3 


21.5 


22.7 


100.0 


100.5 




Other-CE/Title I 


96.5 


33.0 


33.1 


99.4 


99.4 


4 


Othe*-CE/Other-CE 


99.5 


29,0 


29.4 


99.3 


100.2 




v Needy Non-CE/CE 


102.0 


26.6 


27.4 


1C0. 4 


100.8 




Needy Non-CE/Non-CE 


102.5 


23.9 


24:7 


100.2 


99.8 




Title I/Title I 


93.3 


21.0 


21.2 


102.5 


99.9 




Other-CEAitle I 


88.5 


35.1 


34 M 


101.3 


99.4 


5 


Other-CE/Other-CE 


103.3 - 


. 26.5 


27.5 


102.9 


100.5 




Needy Non-CE/CE 


91.6 


25.9 


26.0 


101.1 


100.4 




Needy Non-CE/Non-CE, 


83.7 . 


20.4 


20.2 


100.1 


99.3 




Title I/Title I 


100-.0 


20.1 


21.1 


99.4 


101.3 




Other-CE/Title I 


103.3 


33.3 


34.1 


99.6 


100.4 


6 


Other-CE/Other-CE 


- 80.8 


23.0 


22.1 


97.9 


99.8 




Needy Non -CE/CE 


91.9 


27.8 


27,7 


98.9 


100.6 




Needy Non-CE/Non-CE 


96.7 


21.9 


22.4 


98.8 


100.6 



Sample sizejs for these groups are available in tables presented earlier and therefore 
are omitted here. 

Model A - Regression of posttest score on pretest and selected student background 
characteristics as estimated from data from non-CE students attending schools that 
do not provide CE in reading; Model B »- Similar to Model A but the regression 
equation was estimated from data for non-CE students attending schools that provide 
C& in reading. Please refer to Appendix B5 for further descriptions of these models. 
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Table E-2 



Indicators of Fall-to-Spring Math Achievement Growth for CE Students and 
Two Comparison Groups of Non-CE Students Judged to be in Need of Math CE 



Math 
CE Students and 
Comparison Groups* 

Selection/School 



Mean VSS Gain as 
a Percentage of 
that Required to 
Maintain the 50th 
Percentile Rank 



Average 
Pretest 
Percentile 
Score 



Average 
Posttest 
Percentile 
Score 



Mean Posttest Score 
as a Percentage of 
the Expected Mean 
Estimated With 

Model A*» Model B** 



Title I/Title I 97,7 

Other-CEAitle I 90,8 

Other-CE/Other-CE 99 . 1 

Needy Non-CE/CE * 85,9 

Needy Non-CE/Non-CE 78.0 



Title I/Title I 95.4 

Other-CEAitle I 96.4 

Other-CE/Other-CE .97.1 

Needy Non-CE/CE "90.1 

Needy Non-CE/Non-CE 83.5 



30.8 
43.6 
42.0 
26.0 
29.0 



33.8 
41.7 
44.2 
26.2 
25.1 



27.5 
42.8 
38.7 
26.5 
25.6 



29.1 
42*. 4 
39.7 
26.6 
24.5 



103.2 
100.3 
101.2 
101.3 
100.2 



100.5 
100\0 
100.0 
100.3 
99.4 



101.3* 
99.1 
100.3 
100.0 
99.0 



99.2 
99.4 
99.7 
101.1 
100.2 



Title I/Title I 96.3 

Other-CEAitle I 86.6 

Other-CE/Other-CE 80 . 6 

Needy Non-CE/CE 85.3 

Needy Non-CE/Non-CE 87.1 



Title I/Title I * 86.8 

Other-CEAitle I 73.6 

Other-CE/Othe r-CE 5 5 . 1 „ 

Needy Non-CE/CE m *78.4 

Needy Non-CE/Non-CE 76.4 



Title a/Title I 113.9 

Other-CEAitle I 97.9 

Other-CE/Other-CE 109. 6 

Needy Non-CE/CE 100-.9 

Needy Non-CE/flon-CE 92.9 



26.1 
40.2 
^7.4 
25.5 
24.4 



30.1 
40.2 
34.3 
25.7 
23.7 



23.4 
37.5 
33.7 
25.5 
24.5 



25.7 
35.9 
28.8 
25.6 
25.0 



23.2 
38.8 
28.6 
24.7 
23.3 



25.8 
37.8 
29.5 
25.6 
23.8 



103.4 
99.1 
100.3 
100.5 
100.0 



100.3 
99.6 
97.4 

100.3 
99.8 



101.4 
100.0 
99.9 
101.2, 
100.0 



99.7 
97.9 
98.0 
98.3 
98.3 



9&. 1 

99. 2 
96.6 
98.3 
97.9 



100.9 
99.4 
99.7 

100.7 
99.7 



Title iAitle I 85.5 

Other-CEAitle I 7C.1 

Other-CE/Other-CE . 70 . 3 

Needy Non-CE/CE 68.8 

Needy Non-CE/Non-CE 65.5 



25.5 
.36.8 
25.8 
26.7 
24.6 



28.0 
36.3 
25.4 
26.2 
24.0 



102.0 
100.1 

99.2 
100 .JB 

99.9 



102.2 
99.9 
99.4 
99.9 
99.0 



Sample sizes' for these groups are available in tables presented earlier and therefore 
are omitted here. * 
Model A— Regression of posttest score on pretest and selected student background 
characteristics as estimated from data for non-CE students attending schools that do 
not provide CE in math; Model B - Similar to Model A but the~ regression equation 
was estimated from data for non-CE students attending schools that provide CE in 
math. Please' refer to Appendix B5 for further descriptions of these models, 
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Table E-3 



Projected Population Means of Hours of Instructional Services Received 

in the 1976-77 School Year for Special and Non-Special Instruction* 
•J • 11 



"Grade 



Projected Means for Reading 



Special 
Instruction 



Non-Special 
Instruction 



1 


59.44 


2 


. 59.70 


3 


46.97 


4 


35.77 


5 


31.49 


6 


30.28 



242.38 
228.10 
185.26 
163.04 
158.62 
147.85' 



Projected Means for Math 



Special 
Instruction 



16.34 
21.19 
18.67 
22.11 
24.16 
18.07 



Non-Special 
Instruction 



149.89 
147.95 
146.63 
145.10 
142. '88 
144.14 



Special Instruction: instruction by special teachers, and assistants/aides, 
and instruction by classroom teachers in- small groups (1-6); 

Non-Special Instruction: instruction by classroom teachers in groups of » 
7 or more, instruction by tutor, and Independent seat work. 
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Table E-4 



Average Pretest VSS in Reading for Reading CE Students by Participation 
History and Intensity of Reading Services Received 



R Reading CE Status 
A in 1975-X977 

D school Years (A) 
E 



Amount of Services Received from Special Teachers and 
in Small Groups /Amount of Services Received in Less 
Intensive Settings (B) 

High/High High/Low Low/High Low/Low Total 



ANOVA Test 
Statistics 

Effect* I 



^Received CE 
76 and 75 

Received CE 
76, not 75 

Inconsistent 
76 CE Data 

Total 



N 

Mean 
N 

Mean 

N 

Mean 
N 

Mean 



126 
326.9 

169 
323.3 

162 
334.5 

457 
328.3 



341 
327-7 

470 
321.2 

442 
332.9 

1,253 
327.1 



31 
343.0 

67 
318.0 

253 
348.4 

351 
342.1 



84 
333.0 

69 
318.4 

225 
338.0 e 

378 
333.3 



582 
329.1 

775 
321.1 

1,082 
337.8 

2,439 
330.4 



Received CE 
76 and 75 

Received CE 
76, not' 75 

Inconsistent 
76 CE Data 

Total 



N 

Mean 
N 

Mean 
N 

Mean 
N 

Mean 



257 
377.5 

108 
388.4 

147 
404.9 

512 
387.6 



604 
374.9 

402 
378.5 

386 
392.2 

1,392 
380.8 



103 
392.7 

60 
394.0 

329 
414.7 

492 
407.6 



155 
378.1 

52 
388.0 

256 
408.6 

463 
396.1 



1,119 
377.6 

622 
382.5 

1,118 
404.3 

2,859 
389.1 



Received CE 
76 and 75 

Received CE 
76, not 75 

Inconsistent 
76 CE Data 

Total 



N 

Mean 
N 

Mean 
N 

Mean 
N 

Mean 



369 
417.5 

107 
421.1 

153 
449.1 

629 
425.8 



833 
410.2 

165 
407.1 

372 
423.5 

1,370 
413.4 



123 
428.7 

c 22 
420.8 

242 
467.8 

387 
452.7 



114 
428.7 

22 
432.8 

168 
444.7 

304 
437.9 



1,439- 
41b. 1 

316 
414.6 

935 
443.0 

2,690 
424.7 



Received CE 
76 and 75 

Received CE 
76, not 75 

Inconsistent 
76 CE Data 

Total 



N 

Mean 
N 

Mean 



Mean 
N 



322 
437.1 

104 
447.8 

122 
470.0 

548 
446.4 



657 
434.6 

147 
437.0 

293 
464 .2 

1,097 
442.8 



179 
448.7 

25 
467.6 

227 
490.4 

431 
471.8 



58 
453.5 

5 

482.6 

69 
494.1 

132 
475.8 



1,216 
438.2 

281 
444.5 

711 
476.5 

2,208 
451.3 



24.64** 



a|b 50.49** 
A|B,AxB 53.88** * 

AxB|A,B 3.51** 



B 59.87** 

a|b 84.57** 

A|B,AxB 82.47** 

AxBlA,B 1.74 



B 99.00** 

A|B 74.71** 

A|B,AxB 78.11*Y 

AxB|A,B 6.04** 



B 54.30** 

a|b 113.47** 

A|B,A*B 83.94**^ 

A*B|A,B 1.30 



Received CE 
76 and 75 

Received CE 
76, not 75 

Inconsistent 
76 CE Data 

Total 



N 

Mean 
N 

Mean 
N 

Mean 
N 

Mean 



317 
462.9 

65 
469.2 

105 
487.6 

487 
469.1 



6?1 
459.5 

110 
475.9 

244 
475.6 

975 
465.4 



194 
470.7 

53 
485.7 

178 
515.8 

425 
491.5 



78 
488.2 

19 
509.0 

91 
510.2 

168 
501.0 



1,210 
464.0 

247 
478.8 

618 
494.3 

2,075 
474.8 



Received CE 
76 and 75 

Received CE 
76, not 75 

Inconsistent 
76 CE Data 

Total 



KotatiOns: AxB 



N 

Mean 
N 

Mean 
N 

Mean 
N 

Mean 



370 
490.9 

79 
489.5 

98 
521.5 

547 
496.2 



^527 
479.1, 

104 
481.6 

208 
499.8 

839 
484.6 



169 
498.0 

36 
498.8 

192 
525.4 

397 
511.3 



74 
507.4 

26 
513.5 

205 
563.5 

305 
545.6 



1,140 
487.6 

245 
490.0 

703 
528.4 ' 

2,088 
501.6 



B 



48.92** 



AlB 54.22** 
A| B,A*B 46.92** 

AxB|A,B 4.39** 



B 106.56** 

a)b 64.38** 

A| B,AxB 72.99** 

*«<B| %B 3.48** 



interaction effect; A|B (A|B, A x B) - A effect conditional on B (B and AxB) effect(s). 



F-test is significant at .01 level. 
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/ " f Table E-5 <. 

Average Pretest VSS in Reading for Reading CE Students by Participation 
, Historv and Cost Levels of Instructional Services Received 



R Reading CE Status 
«A in 1975-1977 



Cost of Services in Categories Defined by the Mean 
and ±1 Standard Deviation of Costs for CE Students (B) 



ANOVA Test 
Statistics 



* D 
E 


School Years (A) 




High 


High 
Average 


Low 
Average 


Low 


Total 


Effect* 


F 




Received CE 
76 and 75 , 


Mean 


93 
327. 7« 


1S5 
328.1 


235 
331.0 


- 69 
3^7. l' 


582 
329.1 


B 

a| b 


5.56** 
63.33** 


1 


Received CE 
76, not 75 


N 
Mean 


166 
321.5 


217 
320.4 


329 
320.7" 


54 
323.2 


766 
321.0 


a|b,a*b 

AXB| A,B 


35.49** 
1.35 




Inconsistent 
76 CE Data 


n; 

Mean 


100 
328.8 


250 
338.3 


523 
339.4 


193 
338.0 


1,066 
337.9 








Total 


N 
Mean 


359 
325.1 


652 
329.5 


1,087 
332.0 


316 
333.1 


2,414 
330.4 








Received CE 
76 and 75 


N 
Mean 


172 
374.3 


378 ' 
376.1 


468 
380.7 


98 
375.5 


1,116 
377.7 


B 

a|b 


19.7)** 
112.08** 


2 


Received CE 
76, not 75 


. N 
Mean 


121 
378.8 


201 
383.0 


256 
382.6 


42 
390.5 


620 
382.5 


a|b,a*b 

A*B| A,B 


81.72** 
1.68 




Inconsistent 
76 CE data 


N 

Mean 


90 
392.1 


242 t 
4U0.5 


530 
405.1 


216 
413.0 


1,078 
404.5 






* 


Total 


N 

Mean 


383 
379.9 


821 
385.0 


1,254 
391.4 


356 ' 
400.0 


2,814 
389.0 






» <> 


Received CE 
76 and 75 


N 

Mean 


273 
409.6 


448 
413.2 


553 
416.7 


120 
423.3 


1,394 
414.7 


B 

a|b 


32.40** 
92.81** 


3 


Received CE 
76, not 75 


N 

Mean 


62 
407.2 


111 
420.6 


120 
409.0 


22 
436.0 


315 
414.6 


a|b,a*b 

A* B | A , B 


45.42** 

3.65 




Inconsistent 
76 CE Data 


N 

Mean 


65 
416.3 


142 
438.6 


0472 
446.0 


204 
448.1 


883 
443.2 








Total 


N 

Mean 


400 
410.3 


701 
419.5 


1,145 
428.0 


346 
438.8 


2,592 
424.4 








Received CE 
76 and 75 


N 

Mean 


235 
434.4 


391 
432.7 


464 
443.6 


107 
445.2 


1,197 
438.4 


B 

a|b 


34.09** 
104.98** 


4 


Received CE 
76,, not 75 


N 

Mean 


59 
442.2 


82 
439.6 


101 
449.0 


24 
440.8 


266 
443.9 


. a|b,axb 

A* B j A , B 


67.76** 
1.01 




Inconsistent 
76 CE Data 


N 

Mean 


47 
45^.5 


146 
463.2 


273 
480.7 


* 201 
481.7 


667 
475.5 








Total 


N 

Mean 


341 
438.8 


' 619 
440.8 


838 
456.4 


332 
467.0 


2,130 
450.7 






• 


f Received CE 
76 and 75 


N 

Mean 


217 
449.4 


395 
463.0 


480 
468.8 


97 
478.9 


1,189 
464.2 


. B 

a|b 


41.98** 
47.65** 


5 


Received CE 
76,, not 75 


N 

Mean 


43 
479.1 


77 

' 463.9 


94 
483.6 


19 
503.9 


233 
477.9 


a|b,a*b 

A*B| A,B 


37.16** 
1.94 




Inconsistent 
76 CE Data 


N 

Mean 


41 
474.4 


114 
480.9 


288 
493.7 


139 
513.3 


582 
494.5 








• Total 


N 

Mean 


301 
457.1 


586 
466.6 


862 
478.7 


255 
499.5 


2,004 
474.6 








Received CE 
76 and 75 


N 

Mean 


228 
483.7 


360 
483.9 


458 
491.2 


64 
500.8 


1,110 
487.8 


B 

a|b 


65.53** 
67.79** 


6 


Received CE 
76, not 75 


N 

Mean 


35 
496.0 


88 ' 
479.1 


86 
491.7 


26 
512.4 


235 
489.9 


a|b,a*b 
a*b| a,b 


30.16** 
4.95** 




Inconsistent 
76 CE Data 


N 

Mean 


37 
482.0 


117 
503.5 


332 
527.9 


185 
553.8 


671 
528.3 








Total 


N 

Mean 


300 
484:9 


565 
487.2 


876 
505.2 


275 
537.5 


2,016 
501.5 







Notations: A*B - interaction 
*F-test is significant at .01 



effect; 
level. 



a|b (a|b, A*B) - A effect conditional on B (B and A*B) effect(s). 
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Table 

Average Pretest VSS in Math for Math CE Students by Participation 
History and Intensity of Math Services Received 



G 

R Hath CE Status 
k in 1975-1977 
D School Years (A) 
E 



Amount of Services Received from Special Teachers ana 
in Small Groups/Amount of Services Received in Less 
Intensive Settings (B) 



High/High High/Low Low/High Low/Low 



Total 



ANOVA Test 
Statistics 



Effect* 





Received CE 
76 and 75 


N 

Mean 


32 
313.2 


353 
314.4 


21 
333.4 


26 
331.7 


432 
316.3 


B 

a|b 


38.78** 
11.05** 


1 


Received CE 
76, not 75 


N 

Mean 


26 
312.7 


197 
306.1 


10 
292.9 


14 
311.6 


247 
306.6 


a|b,axb 

AxB|A,B 


11.28** 
2.52 




Inconsistent 
76 CE Data 


N 

Mean 


85 
310.4 


332 
317.0 


158 
339.7 


157 
337.3 


732 
325.5 








Total 


N 

Mean 


143 
311.4 


882 
313.5 


189 
336.6 


197 
334.7 


1,411 
319.4 








Received CE 
76 and 75 


N 

Mean 


45 
359.4 


286 
361.6 


60 
372.3 


81 
363.9 


472 
363.1 


B 

a|b 


6.18** 
38.48** 


2 


Received CE 
76, not 75 


N 

Mean 


66 
367.1 


115 
363.5 


17 
388.6 


28 
374.9 


226 
367.9 


A|B,AxB 
AxB|A,B 


25.79** 
1.17 




Inconsistent 
76 CE Data 


N 

Mean 


118 
383.6 


306 
384.3 


193 
383.6 


263 
387.8 


880 
385.1 








Total 


N 
Mean 


229 
374.1 


707 
371.7 


270 
381.5 


372 
381.6 


1,578 
376.1 








Received CE 
76 and 75 


N 

Mean 


123 
413.8 


387 
406.5- 


93 
412.1 


19 
400.3 


622 
408.6 


B 

a|b 


13.00** 
25.57** 


3 


Received CE 
76, not 75 


' N 
Mean 


95 
406.7 


115 
414.7 


33 
416.0 


16 
417.3 


259 
412.1 


A j B , A* B 
AxB|A,B 


14.15** 
1.95 




Inconsistent 
76 CE Data 


N 

Mean 


96 
420.6 


365 
422.3 


234 
440.4 


65 
422.5 


760 
427.7 








Total 


Mean 


314 
413.7 


867 
414.2 


360 
430.9 


100 
417.5 


1,641 
418.0 








Received CE 
76 and 75 


Mean 


123 
440.9 


303 
445.3 


121 
, 451.5 


16 
458.5 


446.1 


B 

A j B 


23.90** 
C4.36** 


4 


Received CE 
76, not 75 


N 

Mean 


58 
454.4 


109 
449.3 


34 
467.7 


13 
436.3 


214 
452.8 


a|b,a*b 
axb|a,b 


35.90** 
1.71 




Inconsistent 
76 CE Data 


N 

Mean 


86 
467.7 


236 
472.6 


232 
493.3 


92 
495.4 


646 
482.6 








Total 


N 

Mean 


267 
452.4 


648 
455.9 


387 
478.0 


121 
484.2 


1,423 
463.7 








Received CE 
76 and 75 


N 

Mean 


' 144 
477.8 


254 
474.4 


102 
508.0 


48 ' 
499.5 


548 
483.8 


B 

a|b 


30.02** 
33.27** 


5 


Received CE 
76, not 75 


N 

"Mean 


59 
497.3 


108 
485.0 


37 
494.2 


25 
527.6 


229 
494.3 


A|B,AxB 
A x Bj A/B 


23.38** 
1.45 




Inconsistent 
76 CE Data 


N 

Mean 


59 
504.2 


o An 
£X>KJ 

504.6 


176 
528.1 


93 
529.1 


588 
515.5 








Total 


N 

Mean 


262 
488.2 


622 
488.9 


315 
517.6 


166 
520.3 


1,365 
* 499.2 








Received CE 
76 and 75 


N 
Mean 


141 
526.4 


303 
503.9 


84 
554.8 


62 
533.9 


590 
519.7 


B . 

a|b 


19.89** 
33.36** 


6 


Received CE 
76, not 75 


N 

Mean 


35 
499.0 


87 
540.7 


18 
571.7 


16 
558.6 


156 
536.8 


a|b,a*b 

AxB|A,B 


,16. 58** 
6.36** 




< 

Inconsistent 
76 CE Data 


N 

Mean 


70 
554.6 


337 
545.8 


151 
562.0 


151 
548.4 


709 
550.7 








Total 


N 

Mean 


246 
530.6 


727 
527.7 


253 
560 . 3 


229 
545.2 


1,455 
536.6 







'notations: AxB - interaction effect; A| B <a|b, AxB) - A effect conditional on B (B and AxB) effect (s). 
*P-test is significant at .01 level. 
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Table E-7 

Average Pretest VSS in Math for Math CE Students by Participation 
History and Cost Levels of Instructional Services Received 



G 

r Math CE Status 
A in 1975-1977 
D School Years (A) 
£ 



Cost of Services in Categories Defined by the Mean 
and ±1 Standard Deviation of Costs for CE Students (B) 



High 



High 
Average 



Low 
Average 



Low 



Total 



AN^ a Test 
Statistics 

Effect* F 





Received CE 
76 £*^d 75 


N 
M^an 


57 
315 .9 


166 
315.4 


186 
316.2 


23 
324.0 


432 
316.3 


B 

a| b 


18.23** 
20.22** 


1 


Received CE 
76, not 75 


N 
Mean 


45 
299 . 4 


84 
307.0 


102 
306.2 


15 
324.5 


246 
306.4 


a|b,a*b 
a*b|a,b 


5.78** 
3.89** 

1 




Inconsistent 
76 CE Data 


N 

Mean 


57 
294 . 7 


169 
326.4 


381 
326.8 


123 
334.9 


730 
325.5 




I 




Total 


N 


159 
303.6 


419 
318.1 


669 
320.7 


161 
332.3 


1,408 
319.3 








Received CE 
/o ana 


N 


84 
356.4 


164 
363.1 


183 
365.7 


37 
365.9 


468 
363.1 


B . 

a|b 


7.01** 
39.22** 


• 

2 


Received CE 
76^, not 75 


N 

Mean 


61 

jDh . 4 


65 
364 .0 


97 
372.4 


3 

375.3 


226 
367,9 


a|b,a*b 
a*b|a,b 


30.26** 

0.62 




Inconsistent 
76 CE Data 


N 

Mean 


70 
380 . 4 


188 
387. 5 


484 
383.7 


108 
393.2 


850 
385.5 








Total 


N 


215 
366. 5 


417 
374.2 


764 
378.0 


148 
386.0 


1,544 
376.1 








Received CE 
76 and 75 


N 

Mean 


116 
401 .8 


188 
407.5 


260 
414.5 


38 
394.2 


602 
408.6 


B 

a|b - 


12.75** 
21.40** * 


3 


Received CE 
76/ not 75 


N 
Mean 


79 
417 5 


80 
406 6 


89 
411.9 


11 
415.5 


259 
412.1 


a|b,a*b 
a*b|a,b 


17.00** 
3.01** 




Inconsistent 
76 CE Data 


N 

Mean 


32 
424 . 3 


143 
410. 8 


402 
432.4 


•117 
429.7 


694 
427.1 








Total 


N 

Mean 


227 
410.4 


411 
4C8.5 


751 
423.8 


166 
420.6 


1,555 
417.5 








Received CE 
76 and 75 


N 

Mean 


118 
437.9 


177 
448.1 


242 
449.9 


16 
454.1 


553 
446.9 


B 

a|b 


17.63** 
48.47** 


4 


Received CE 
76, not 75 


N 

Mean 


30 
451.9 


57 
460.6 


" 107 
449.6 


8 

468.3 


202 
453.8 


a|b,a*b 
a*b|a,b 


18.01** 
1.43 


* 


»J T ncon si stent 
• 76 CE Data 


N 

Mean 


33 
447.1 


112 
481.6 


373 
482.6 


86 
493.8 


604 
482.1 








Total 


N 

Mean 


181 
441.9 


346 
461.0 


722 
466.8 


110 
486.1 


1,359 
463.6 








Received CE o 
76 and 75 


N 

Mean 


109 
474.4 


148 
483.5 


258 
484.2 


31 
513.2 


546 
483.7 


B 

a|b 


20.02** 
29.93** 


5 


Received CE 
76, not 75 


N • 
Mean 


38 
486.3 


78 
499.7 


97 
487.3 


11 
542.7 


224 
494.2 


a|b,a*b 

AxB|A,B 


8,52** 

2.53 



Inconsistent 
76 CE Data 



Total 



8,43** 
31.08** 




'Notations: A X B - interaction effect 
*F-test is significant t .01 level. 



B 

a|b 

aJb,A*B 10.06 
A*B|A,B 2.26 



a|b (a|b, A*B) - A effect conditional on B CB and Ax B ) effect(s)* 
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MttC of Thiee Different Measures of Reading Achievement Cain for Reading CT Students by Exposure 
to Reading Ct in th© 'receding Year and Intensity of Reading Service, and AMOOVA of Gains by Exposure 
to Reading ct in the Preceding Year, with Aaounts of Reading Services as tho Covarlate t 



Hooding Ct Status 

tr 1975-1977 
School Tears (A) 



Aeount of Servlcee Received by Special 
Tractors and in SmI 1 Croupa/Xeount of Servlcee 
Received in Lass Intanslvt Settings <B> 



High/ 

Hi?! 



High/ 



L.w/ 
High 



Low/ 
Low 



ANOVA Test 
Statistics 



AMCOVA Tast Statistics. Hours of 
Instruction in Three Settings ss Covarlataa 



Adjusted 
Means 



f-Taat for f-Teat for 
Equality of equality 
Adjusted Meana of Slopes 



Maan Cains in Teres of Standardized (x) Scoraa 



Received Ct 76 and 75 
Received Ct H. not, 75 
^consistent 76 CE Data 
Total 

Received Ct 76 and 75 
tectlvtd Ct 76. not ?S 
Ineons: stent 76 Ct Data 
Total 

Received Ct 76 and 75 
P*otlv*d Ct 76. not 75 
Xnconslstant 76 ct Data 

Total 

■* 

Received Ct 76 and 75 
Received Ct H, not 75 
Inconsistent 76 Ct Data 
Total 

Received Ct 74 and 75 
Received Ct "6. not 75 
Inconsistent 76 Ct Data 
Total 

Received Ct 76 and 75 
Received ct 76. not 75 
Inconsistent 76 CE Data 
Total 



0.247 
0.20) 
-0.109 
0.104 

0.016 
0.055 
-0.02* 
0.013 

0.074 
0.138 
0.033 
0.074 

0.010 
0.050 
-0.026 
0.010 

0.031 
0.047 
0.029 
0.033 

0.062 
-0.014 
-0.019 

0.037 



-0.0,20 
0.026 
•0.112 
-0.035 

0.058 
0.104 
0.024 
0.062 

0.097 
0.027 
-0.014 
0.052 

0.064 
0.032 
-0.020 
0.037 

0.031 
0.085 
-0.043 
0.019 

0.020 
.0.094 
-0.019 

0.020 



-0.139 
0.042 
-0.058 
-0.046 

0.005 
0.149 
-0.007 
0.015 

0.076 
0.143 
-0.058 
-0.004 

-0.127 
-0.092 
0.019 
-0.048 

-0.037 
-0.068 
-0.038 
-0.041 

0.049 
0.028 
0.009 
0.028 



-0.092 
-0.027 
•0.124 
-0.099 

0.066 
0.038 
0.032 
0.051 

0.0)5 
-0.097 
0.010 
0.012 

0.065 
-0.126 
0.064 
0.058 

-0.023 
0.151 
-0.019 
-0.004 

-0.013 
0.219 
-0.04JI 
-0.012 



0.021 
0.061 , 
•0.101 
•0.021 

0.048 
0.094 
0.011 
0.043 

0.084 
0.064 
-0.01) 
0.048 

0.022 
0.025 
-0.001 
0.015 

0.017 
0.047 
-0.026 
0.008 

0.0)6 
0.06) 
-0.018 
0.021 



Mean Reeldual Cain Scores Based on the 
ratine ted Regression Using Data frost 
Noo-Ct Students Attending Non-Ct Schools 



Received Ct *76 and 75 


1 23.01 


6 


37 


7.11 


5 


92 


11.12 


Deceived CE 76. not 75 


IS. 32 


6 


44 


5.04 


-1 


06 


7.59 


Inconsistent 76 Ct Data 


-6.18 


•6 


47 


-0.18 


-5 


59 


-4.77 


Total 


9.82 


2 


41 


1.46 


-2 


21 


2.95 


Received Ct 76 and 75 


-1.56 


-3 


02 


1.70 


0 


81 


-1.72 


Received <t 76, not 75 


2.65 


0 


46 


!0.40 


1 


65 


1.90 


Inconsistent H Ct Data 


1.14 


-1 


95 


1.1* 


1 


62 


0.18 


Total ' 


0.10 


-1 


72 


2.38 


1 


15 


-0.19 


Received Ct 74 *rd 75 


1.52 


-0 


68 


3.71 


0 


65 


0.37 


Received Ct 76, not 75 


5.66 


• 4 


25 


4.55 


-7 


84 


-0.5) 


Inconsistent 76 Ct Data 


-5.22 


-8 


19 


-6.69 


-5 


00 


-6.82 


Total 


0.59 


-) 


20 


-2.75 


-1 


09 


-2.24 


Received CE 76 and 75 


-0.89 


1 


78 


-8.87 


3 


09 


-0.4) 


Received Ct 76, not 75 


2.63 


-1 


52 


0.58 


-4 


65 


0.15 


Inconsistent 76 Ct Data 


-4.69 


-6 


51 


-0.99 


2 


95 


-).52 


Total 


-1.07 


-0 


88 


-4.17 


2 


72 


-l.)5 


Kecslved Ct 76 and '* 


21.66 


20 


62 


17 22 


21 


81 


,20.4) 


Received Ct '8. not 75 


0.75 


6 


55 


•5.25 


6 


80 


2.51 


Inconsistent 76 Ct Data 


0.30 


-5 


53 


-3.20 


-0 


95 


-1.19 


Total 


14.26 


12 


49 


5.87 


9 


28 


11.26 


Received CC and 


-1.13 


-8 


04 


-3.39 


-6 


30 


-4.99 


Received Ct 76, not 75 


-7.90 


-2.25 


-3.84 


10 


38 


-2.96 


Inconsistent 76 Ct Data 


-4.78 


-7.93 


-3.71 


-0 


.79 


-4.26 


Total 


-2. '6 


-7 


29 


-1.59 


-1 


.18 


-4.51 



Hean Realdual Cain Scores Baaed on the 
Estimated Regression Uelng Data frost 
Non-Ct Stuiente Attending CE Schools 



Received CE 76 and 75 
Received CE 74, not 75 
Inconsistent 76 Ct Data 
Tfljal 

Received CE '* and 75 
Received CE 76, not 75 
Inconsistent 76 CE Data 
Total jg> 

Receive! CE '8 and 75 
Received CE 76 not 75 
Inconsistent 71 Ct Data 
Total 

Received Ct 76 And 75 
Received Ct 76, not 75 
Inconalatent 76 CE Data 
Total 

Received CE 76 and '5 
Received CE 76. not 75 
Inconalatent 76 Ct Data 
Total 

Received Ct 76 and 75 
Received Ct 76. not 75 
Inconsistent 76 CE Data 
Total 



26.34 


12.08 


11.86 


10.20 


14.88 


11.68 


1.19 


-0.46 


-5.20 


2.76 


-8.43 


-10.13 


-2.15 


-9.59 


-7.90 


8.59 


0.16 


-0.59 


-4.39 


0.9) 


-3 45 


-4.55 


1.85 


-0 42 


-).l) 


4.8) 


4.21 


11.69 


3.15 


4.97 


-0.51 


-2.76 


-1.86 


-0.16 


-1.60 


-0.86 


-1 52 


0.57 


0.15 


-0.77 


1.03 


2.59 


3.29 


1.29 


2.66 


7.36 


-0.61 


6.42 


-6.18 


2.19 


-4.34 


-6.22 


-8.23 


-4.59 


-6.14 


1 97 


-0.18 


-3.74 


-2.50 


-0.45 


3.96 


5.74 


-0.88 


9.79 


4.49 


1.21 


-6.00 


1.22 


-4.3) 


-2.66 


-5.13 


-6.51 


-0.95 


1.11 


-).77 


1.41 


0.89 


-0.79 


4.72 


0.92 


0.87 


-0.66 


-2.08 


-0.22 


-0.46 


1.67 


7.50 


-1.11 


13.22 


4.56 


0.18 


-4.58 


-1.87 


•1.70 


-2.5) 


0.87 


• 0.*2 


-1.87 


0.42 


•0.48 


10.72 


5.20 


10.31 


4.10 


7.68 


-1.94 


6.63 


2.84 


)2.75 


3.96 


-2.67 


-3.19 


0.04 


-3.2) 


-2.25 


6.49 


1.30 


4 6* 


•0.09 


).9" 



8 

A|B 

A{8.A»8 
A*8|A.B 


4.89" 
8.21" 
6.08" 
1.50 


0.031 
0.064 
-0.109 


10.38" 


4.64" 


B 

a|b 

AJB.Am* 
a»b|a.b 


1.05 
2.81 
1.92 
0.27 


0.049 
0.097 
0.007 


3.48 


1.05 


B 

AjB 

A|8.A«B 

a*b|a.b 


2.2) 
6.63" 
4.04 
1.2) 


0.081 
0.062 
-0.007 


6.59" 




B 

A|8 

AjB.AaB 
A*B|A.B 


2.55 
0.10 
0.16 
2.08 


0.020 
0.019 
0.005 


0.15 




B 

a|b 

AjB. AxB 
A*B|A.B 


2.09 
1.87 
1.39 
0.86 


0.013 
0.047 
-0.018 






B 

Mi 

A|B,A*B 
A.BfA.B 


0.77 
1.45 
1.82 
1.49 


0.031 
0.059 
-0.009 


2.36 




2b 

a|b.a*b 
a*b|a.b 


9.01 •• 
46.15" 
29.92" 

3.04" 


11.90 
7.62 
-5 21 


51.87" 


4.69" 


B 

lift 

A B 

A|B.A»fc 
AuBjA.B 


2.25 

1.91 
0.41 


-1.18 
2.57 
-0.73 


2 .69 


0.99 


B 

a|b 

A]B,A»B 
A.S|A, B 


2.50 
17.40" 
13.54" 

1.11 


0.76 
-0.29 
-7.51 


20.55" 




B 

a|b 

AjB.AuB 
A»8|A.B 


1.64 

1.7) 
0.16 
2.78 


•0 42 
0.02 
-3 48 

1 


1.84 


1 .16 


B 

AtB 

a|b,a»b 

*«B[A.S 


5.13" 
95.31" 
67. 18" 

0.95 


, 20.39 
2.50 
-3 12 


92.65" 


1 .67 


B 

a|d 

AJB.AXB 
A»B| A.B 


3.24 
0.14 
0.87 
1.52 


-5 16 
-2.96 
-1 99 


0.50 


2.9!" 


\u 

AjB.AxB 
A»8|A.B 


11.12 
82. 51" 
51.41" 
2.88" 


15.79 
2.77 
-8.19 


91.46" 
1 


4.31" 


B 

a!d 

a|b,a«b 

A.BjArB 


0.59 
11.07" 
6. 80" 
0.64 


-2.'1 
5.4B 
-2.11 


11.24" 


1.82 


B 

a!b 

A|BfAmB 

a»b|a.b 


3.45 
21.9)" 
16.70" 

1.17 


2.84 
2.38 t 
•6.47 


26.17" 


1.8) 


B 

aIb 

a|b,a*b 
a«r|a,b 


0.90 
14. 26" 
6.65" 
1.91 


4.60 
-2.61 
-3.99 


14.4*1" 


0.46 


Hi. 

AjB.AxB 

a*b|a.b 


0.57 
3.80 
2.97 
0.90 


-0 42 
4.54 
-2.59 


3 90 


1.58 


B 

Mb 


2.36 
14. 94" 


7,35 
3.74 


12.27" 





A|B.A>8 
A*B| Af B 



12.68*' 
1.47 



Vxebere of case* in each cell and In earglnals can be found In Table t-4 of Appendix E. 
•notations. A«B - interaction affacti A|i <A|8. A.B) - A effect conditional on B IB and A. 8 1 .ffect(a). 
**f-teet is significant at .01 level. 
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Table 2-9 

Two-«ey AHOVAa of Three Different Hea.urea of Reading Achleve»tnt for Raading CE Student. 
bTSpo^rTto* j**™, eg in the Preceding Year end by Cost fcavsla of Instructional Service.* 



Reeding CE Status 
In 1975-1977 
School Years <A) 



Cost of Service* In Categories Defined by the Ntan 
end S-l Standard Deviation of Costs for CE Students t»> 



Received CE 76 and 75 
Received CE 76, not 75 
Inconsistent 76 CE D*t* | 
Total 

Received CE 76 «nd 75 
Received CE 76, not 75 
Inconsistent 76 CE Data | 
Total 

Received CE 76 and 75 
Received CE 76, not 75 
Inconsistent 76 CE Data] 
Total 

Racolvtd C£ 76 and 75 
Received CE 76, not 75 
Inconsistent 76~CC*'Deta | 
Total, 

^Mcaivad CE 76 and 75 
Received CE 76. not 75 
Inconsistent 76 CE Data | 
Total 

Received CE 76 and 75 
Received CE 76. not 75 
* Inconsistent 76 CE Data 
Total 



Received CE 76 and 75 
Received CE 76, not 75 
Incontinent 76 CE Data 
Total 

Received CE 76 and 75 
Received CE 76, not 75 
Inconsistent 76 CE Data 
Total 

Racaivad CE 76 and 75 
Received CE 76, not 75 
Inconsistent 76 CE Data 
Total 

Receivtd CE 76 and 75 
Racaived CE 76, not 75 
Inconsistent 76 CE Data 
""otal 

Received CE 76 and 75 
R«caivad CE 76, not 75 
Inconsistent 76 CE Data 
Total 

Received CE 76 and 75 
Received CE 76, not 75 
Inconsistent 76 CE Data 
Total 



High 


High 
Average 


Low 
Average 


Low 


Total 


Effect* 


F 


He an 


Cains in Terns of Standardised <x> 


Scores 




1.74 
9.45" 
5.20" 
1.41 


-0.156 
0.078 
•0.207 
-0.062 


0.154 
0.071 
•0.064 
0.043 


-0.006 
0.066 
-0.118 
-0.038 


-3.G05 
•0.045 
-0.028 
-0.026 


coil 

0.062 
-0.097 
-O.018 


B 

a! a 

a|b.a*b 
a-b|a.? 


•0.031 
0.148 

•0.050 
0.021 


0.006 
0.050 
0.075 
0.037 


0.117 
0.135 
0.016 
0.078 


p. 017 
■jo.074 
-0.022 
-0.017 


0.048 
0.096 
0.016 
0.046 


B 

A|B 

A|B.A-8 


2.2^ 
2.8*- 
1.05 
1.92 


0.064 
0.038 
0.083 
0.063 


0.087 
0.114 
0.070 
0.088 


0.096 
0.061 
•0.029 
0.040 


0.124 
-0.098 
-0.066 
-0.002 


0.089 
0.064 
-0.014 
0.051 


A|8 

AJB.AkB 
aJbJA.B 


2.30 
7. 20" 
3.92 
1.50 


0.059 * 
0.045 
0.007 
0.050 


0.024 
0.197 
-0.018 
O.Q37 


-0.004 
-0.076 
-0.012 
-0.015 


0.060 
-0.056 
0.020 
0.027 


0.023 
0.037 
-0.002 
0.017 


II. 

a|8.A«B 
AkB J A. B 


1.51 
0.46 

0.56 
1.58 


0.002 
0.029 
-0.009 
0.005 


0.039 
0.073 
-0.027 
0.030 


0.012 
0.Q20 
-0.019 
0.002 


-0.017 
0.067 
-0.028 
-0.017 


0.016 
0.043 
-0.022 
0.008 


A|B 

AJB.AnB 
Ak8| A.B 


0.69 
1.52 
1.16 
0.16 


0.113 
0.030 
0.110 
0.103 


0.056 
. 0.101 

-o.oo: 

0.051 


-0.008 - 

0.038 
-0.021 
-0.008 


0.002 
0.120 
-0.059 
-0.028 


0.038 
0.070 
-0.021 
0.022 


B 

Mb 

a|b.a«b 

A.8JA.B 


6.17" 
2.08 
1.30 
0.73 



Mean Residual Cain Scores Ba.ed on the Estimated Regression 
Uaing Data free* Hon-CE Studenta Attending Non-CE Schools 

6.49 
1.11 
-2.79 
-0.10 

-3.30 
-2.09 
-0.59 
-1.51 

2.57 
-2.23 
-8.57 
-4.30 

3.27 
-4.47 
-2.18 
-0.59 

19.54 
3.45 
-1.57 
6.83 

-5.66 
3.40 
-4.56 
-4.06 

I Mean Reaiduel Cain Scores Based on the E"l*"«d *«^*» lon 
Using Data fro* Non-CE Studenta Attending CE Schools 



2.U 


16.65 


11.68 


7.15 


8.75 


8.26 


-12.13 


-2.45 


-4.92 


0.48 


6.70 


2.66 


-9.05 


-3.36 


2.76 


2.22 


-0.11 


4.26 


-5.09 


4.63 


0.30 


-4.56 


-0.21 


2.03 


-3.76 


1.18 


1.88 


-5.39 


3.64 


-1.58 


-5.04 


-3.74 


-7.89 


-4.22 


0.57 


-2.51 


1.85 


•0.54 


-1.99 


-0.34 


10.32 


-4.91 


-6.66 


-4.04. 


■4.16 


0.30 


0.07 


-3.05 


17.89 


21.27 


21.05 


1.02 


4.44 


-0.56 


-4.39 


-0.68 


^3.67 


12.44 


14.79 


10.37 


0.03 


-3.37 


-7.93 


-6.31 


-0.35 


-4.29 


0.87 


-5.94 


-4.21 


-0.61 


-3.44 


-6.16 



11.12 


B 


3.92" 


7.65 


Mb 


47.52" 


-4.63 


A|B.A«B 


31.53" 


3.06 


Ax8|A.B 


1.62 


-1.67 


B 


4.12" 


2.02 


A|B 


2.73 


0.64 


AtB.AxB 


2.64 


°-° 5 


AkB] A.B 


2.36 


0.61 




3.31 


-0.53 


Si. 


18.22" 


-7.17 


a|b.a«b 


9.30" 


-2.18 


a»b{a.b 


1.18 


-0.29 




1.30 


0.84 


Mb 


2.48 


-3.71 


AjB.AxB 


2.96 


-1.22 


AiBjA.B 


1.60 


20.42 


1) 


3.63 


1.71 


Mb 


92.09" 


-2.73 


A|B.A*8 


59.59" 


11.52 


A'B|a.b 


0.23 


-4.69 


B 


2.05 


-2.27 


Mb 


0.60 


-4.33 


A|B, AkB 


0.32 


-4.29 


AkB| A.B 


0.82 



Received CE 76 and 75 
Received CE 76, not 75 
Xnconalatent 76 CE Data | 
Total 

Received CE 76 and 75 
Received CE 76, not 75 
Inconsistent 76 CE Data 
Total 

Received CE 76 and 75 
Received CE 76, not 75 
1 inconsistent 76 CE Data | 
Total 

Received CE 76 and 75 
Received CE 76, not 75 
1 Inconsistent -76 CE Data | 
Total 

Received CE 76 and 75 
. Received CE 76, not 75 
* Inconsistent 76 CE Data | 

Total 

Receiv3d CE 76 and 75 
Received CE 76, not 75 
5 Inconsistent 76 CE Data | 
'Total 



8.60 
3.97 
-14.28 
0.08 


19.84 
3.85 

-4.45 
5.21 


14.67 
2.47 
-8.63 
-0.2J 


10.80 
-3.21 
-6.23 
-2.00 


14. E8 
2.79 

-7.75 
1.05 


-10. 18 
6.26 
-4.58 
-3.67 


-5.27 
2.78 
3.38 

-0.75 


1.71 
7.27 
-1.99 
1.28 


-5.06 
-0.72 
-3.39 
-3.53 


-3.08 
5.08 
-1.28 
-0.59 


-1.00 
-2.08 
-2.06 
-1.34 


3.38 
5.57 
-2.00 
2.64 


4.10 
1.85 
-7.27 
-0.82 


4.70 
-0.78 
-8.55 
-3.46 


2.92 
2.20 
-6.33 
-0.32 


6.13 
-3.26 
-5.59 

2.89 


3.30 
6.29 
-5.20 
1.69 


4.05 
-6.92 
-3.97 

0.12 


9.10 
-9.32 
-3.53 

0.12 


4.66 
-2.25 
-4.22 

1.02 


-4.09 
3.37 
-3.70 
-2.97 


0.52 
3.32 
-2.P6 
0.23 


0.67 
3.38 
•2.15 
0.02 


-2.31 
7.36 
-1.46 
-1.13 


-0.49 
3.69 
-2.24 
-0.51 


12.76 
1.48 
5.44 

10.54 


9.44 
7.16 
-1.58 
6.80 


4.48 
1.89 
-2.84 
1.45 


5.99 
6.91 
-3.93 
•0.60 


7.88 
4.36 
-2.46 
4.03 



a]b 

A|B.A*8 
A.B | A.B 

a{b 

AjB.AxB 
A*8|A.B 

II. 

A|a.Ax8 
AxBjA.B 

B 

Mb 

AIB.AkB 
Ak8|A.& 



A*B 

AjB.AxB 

AxB|a.b 
aIb 

a|b.a*b 

A*8|A.B 



4.60" 
80.09" 
58.38" 

1.41 

3.21 
12. 17** 
8.32" 
3.04" 

3.85" 
24.49" 
12.09" 

I. 54 

0.65 
14.56" 
14.44" 

1.62 

0.74 
2.82 
2.48 
0.25 

7.46* 

II. 07« 
7.15* 
0.50 



"r-t.it l« .l9nlflc«nt «t .01 Uv.1. 
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i 



04-B 
CtG x 



• Cains 

KKS (N) 



ANOVA of Three Oifferen' Rsesures of Hath Achievement Cain for Kith CI Students by Exposure 
to Math Ct in the Preceding Year *J*J Intensity of Hath Service, and ANOQYA of Cain* by Exposure 
to Math CI in the Preceding *eer. with Afkou.ts of Kith S*rvlc • as the Cover iatet 



Htth CZ St«tus 
la 197S*1»77 
School Years (A) 



Awunt of Services Received by Special 
Teacher s and in tea 11 Croups/A a w un t of Services 
Received In Less Intensive Settings <») 



Kl<jh/ 
High 



High/ 



Mlrh 



Low/ 



ANOVA Test 
Statistics 



ANCCVA Test Statistics. Hours of 
Instruction In Three Settings as Covarlates 



1Jt , , . r-Test for 
l*»"tv of 



fTest for 

Equality 



r 


Means 


vSjustCO Means 


0 opes 




129 






1 ft* 


.027 


4. ft 




1 47 


• 032 






1.77 






2.54 














0 04 




1 OS 


•0 010 






2.99" 






4.80" 


3.)2 


0.096 






4.79" 


0.130 


3.96 




0.6$ 


•0.003 






2.47 






4.15" 


7.65" 


•0.019 






o.ss 


0.043 


o.so 




1.47 


-0.020 






3.41" 






6.48" 


4.51" 


0.05S 






).62 


0.135 


2.60 




2.46 


0.0:2 






1.54 






0.94 


1.93 


0 086 








0 009 


2.36 




2.22 


0.016 






1.7) 






2.55 


9.57" 


18.32 






20.65" 


6.47 


27.77" 






1 .49 






lilt 






3.09" 




2.01 






048 


J. 79 


l.f*J 




2 90 


K 0.02 






«!«•• 






5.76" 


6.15" 


24 Ot 






89.00" 


6 46 


82.08" 




35.77" 


•4.19 






1.87 






4.41" 


4.90" 


•2 77 






1.06 


1.96 


1.30 




1.59 , 


•3 46 






6 72" 






9.53" 


3.61 


3.77 






7.19" 


12.60 


5,75" 




4.90" 


0.90 






1.20 






1.05 


5.32" 


10 82 




3 


15,64" 


5.62 


9 38" 




13.23" 


•0,77 






0 51 






0.64 

} 


9.31" 


11.35 






17.41" 


1.09 


23,83" 




7.61" 


•3.94 






0.77 






3.11" 


1.37 


•7 24 






10. 49" 


8.02 


11 28" 






•3.42 






5.13" 






8.27" 


6.87" 


-2.64 






6.67" 


•0.25 


5.04" 




1.34 


•8.26 






2.01 






5.21" 


2.S7 


•10.18 






1.34 


-7.18 


2.60 




1.04 


•4.26 






6.22" 






9.09" 


5.00" 


1.56 






8.66*' 


10.92 


6.88* 




5.31" 


•1.97 






1.46 






1.42 


3.90" 


15.09 






30.96" 


•1.23 


24. 42" 




19.79" 


•2.55 






0.76 






1.81 



Mtan Cains In Terms of Standardize* («> Scores 



Received CI 76 and 75 


0.176 


0.191 


•0.409 


-0 


047 


0.147 


Received CI 76, not 75 


-0.016 


0.049 


0.488 


-0 


032 


0.048 


Inconsistent K CI Data 


0.140 


0.080 


•0.279 


-0 


197 


•0.050 


Total 


0.120 


0.116 


-0.253 


-0 


16S 


0.028 


Received 74 and 75 


0.258 


-0.074 


0.050 


0 


030 


-0.009 


Received 76, not 75 


0.029 


-0.033 


•0.447 


0 


373 


0.004 


Inconsistent 76 CZ Data 


-0.028 


0.014 


-0.012 


-0 


014 


-0.006 


Total 


0.045 


-0.029 


-O.025 


0 


025 


-0.005 


Received CI 76 and 75 


-0.006 


0.091 


0 202 


0 


132 


0.090 


Received CI 76, not 75 


0.22» 


0.093 


0.221 


-0 


334 


0.131 


Inconsistent 76 CI Data 


0.128 


•0.09a 


0.103 


0 


010 


0.001 


Total 


0.105 


0.012 


0.139 


-0 


022 


0.055 


Received CI. 7 6 and 75 


0.201 


0.062 


•0.266 


-0 


12* 


0.016 


Received CI 76. not 75 


0.196 


-0.021 


0.102 


-0 


043 


0.056 


Inconsistent 76 CI Data 


-0.079 


-0.010 


•0.098 


-0 


040 


-0.055 


Total 


0.110 


0.022 


•0.133 


-0 


051 


-0.010 


Received CZ 76 and 75 


0.105 


0.113 


-0.062 


0 


016 


0.070 


Received CZ 76, not 75 


0.331 


0.104 


0.134 


0 


004 


0.156 


Inconsistent 76 CI Data 


0.148 


-0.021 


0.020 


-0 


05 S 


0.003 


Total 


0.166 


0.055 


0,-007 


-0 


025 


0.055 


Received CI 76 and 7$ k 


0.043 


0.155 


0.061 


0 


018 


0.100 


Receive' not 75 


0.221 


0.013 


-0.049 


-0 


163 


0.035 


Inconsistent 76 Ct Data 


-0.080 


0.004 


0.073 


-0 


050 


-0.001 


Total 


0.033 


0.06* 


0.060 


-0 


039 


0.044 



Mean Rssldual Cain Scores Rased on the 
title* ted Regression Using Drta fro* 
Hon-CI Students Attending Hon-CI Schools 



Received CZ 76 and 75 
Received CZ 76. act 75 
Inconsistent 76 CI Data 
Total 

Received CZ 76 and 75 
'Received CZ 76. not 75 
Inconsistent 76 CI Data 
Total 

Received CI 76 and 75 
. Received CI 76. not 7$ 
Inconsistent 76 Ct Data 
Total 

deceived CI 76 and 75 
Receive* CI 76, not 75 
Inconsistent 76, Ct Data 
Total 

Rscelved CI 76 and 75 
Received CI 76. not 75 
Inconsistent 76 CI Data 
Total 

Received CI *nd 75 
Received CI 7o. not 75 
Inconsistent 76 CI Data 
Total 



Received CZ 76 and 75 
Received CZ 76. not 75 
Inconsistent 76 Ct Data 
Total 

Received CZ 76 and 75 
Received CZ 76. not 75 
Inconsistent 76 Ct Data 
Total 

Received CZ 76 and 75 
Received CZ 76, not 75 
Inconsistent 76 Ct Data 
Total 

Received CI 76 and 75 
Received CZ 76. not 75 
Inconsistent 76 CI Data 
Total 

Received CI 76 and 75 
Received CZ 76, not 75 
Inconsistent 76 CI Data 
Total 

Rrcelved CI 76 and 75 
Received CI 76, not 75 
Inconsistent 76 CI Data 
Total 



19.25 
6.57 
4.41 
8.12 

13.18 
6.62 

•0.56 
4.21 

22.60 

12.75 
0.19 

12.'7 

10.95 

14.32 
•11.02 
4.60 
6.1> 

2*. 06 
8.87 

11.69 

5.59 
13.32 
-7.10 

3.08 



19.05 
6.36 
5.12 

10.97 

•2.55 
•4.37 
3.74 
0.36 

22.66 
4.38 
•10.60 
6.23 
2.19 
•4.41 
•4.24 
•1.26 

4.76 
9.16 

•2.95 
2.30 

11.50 
5.75 

•2.09 
4.5< 



•0.74 
17.47 
•4.27 
•2.73 

7.53 
-13.90 
•J. 11 
•1.47 

29.35 
16.40 

4.86 
12.43 
•21.7t> 

9.44 
•3.33 
•7.97 

0.64 

9.79 
2.67 
3.0) 

JW «9 
12.80 
7.14 
13.31 



24.12 
6.65 

•J. CI 
1.42 

4.75 
24.62 
•0.32 

2.66 

22.43 
•19.91 
-6.14 
•2.91 
-6.60 
-12.05 
•4.74 
•5.77 
4.14 
6.56 
•3.57 
0.19 

9.33 
•3.14 

•5.04 
•3.00 



18.41 
6.65 
1.31 
7.51 

l.«6 

3.26 
0.43 

I. 15 

2 3.64 

7.74 
•4.10 

6.29 
•1.29 

2.40 
•4.89 
•2.37 

4.34 
13.86 
•0.12 

4.01 

II. 71 
7.35 

•1.89 
4.62 



Mean Residual Cain Scores Based on the 
Cstleated degression Using D/ta frost 
Hon*CI Students Attending CI Schools 



13.13 


i:.3i 


•6.11 


17.30 


11.47 


: 69 


1.01 


6. 


73 


•0.20 


1.35 


•1.19 


-0.60 


•9. 


46 


•7.68 


•4.10 


2.56 


4.93 


•6. 


13 


•4.51 


1.62 


1.45 


•12.93 


4.86 


-4. -14 


•7.82 


10.29 


2.43 


•8.76 


30.26 


7 )) 


•4.99 


0.4) 


•6.10 


•3.62 


•2.94 


0.66 


•4.65 


■•3.83 


•1.23 ^ 


•2.9) 


-5.10 


•3.83 


1 


96 


•2.91 


•).16 


5.24 


-2.60 


8 


30 


•25.69 


0.15 


-4.01 


-14.61 


2 


12 


•12.63 


•7.95 


-1.64 


•8.23 


2 


65 


•12.87 


•4.86 


).18 


•4.60 


-28 


48 


•16.22 


•6.42 


).07 


•12.08 


•0 


61 


•19.55 


•6.61 


12.36 


-5.40 


-4 


39 


-5.52 


•5.96 


-1.65 


•6.15 


•11 


59 


•8.71 


•7.04 


).88 


3.58 


-1 


25 


•1.39 


2.32 


27.64 


6.23 


9 


13 


•1.47 


12 . 37 


7.66 


-5.71 


•0 


70 


6.03 


•).24 


10.1) 


0.50 


0 


27 


•5.12 


1.61 


11.67 


18.77 


17 


86 


9.92 


"16.02 


5.18 


-0.16 


4.39 


•9.42 


0.61 


•8.14 


-5.03 


6.27 


•6.76 


•3.72 


5 11 


5.47 


9.99 


-3.75 


4.75 



Mi 

A|».A*» 
A*8|A.B 
» 

a|» 

A|8.A*B 
A«ft|A.B 

A|B.AkB 

a«b[a.b 
a|b.a*b 

AiS|A.B 



AB 

a|b,AkB 

a»»|a,b 



AB, 

a!b,a*b 

AkB|A,B 



aIb 

a]b,a»b 

A*8]A.B 



A|6,A»« 
AaJJa.B 

a|7 

a|b,a»b 

a»b|a,b 

B 

Mb 

a|b,a>b 
a*b|a.b 

B 

A|B 

A|B.A*B 
A*B|A.B 
B 

A|B 

a|b,a*b 
a*b|a.b 



a!b 

A|B.AxB 
A«$|A.B 

&. 

A| B, AcB 
AxB|A.B 

Hi. 

AjB.' B 

a»b)a,s 

K. 

A]B.AnB 

a»b|a.b 

AiB,A«B 
A»8 A,B 



AB 

a|b.a»b 

A»b{a.B 



f *sBt»rs of cSses in each cell and* In Marginals can be 
"notations! A«i - Interaction effecti A}B (a|b, A*B) • 
"f-test is significant 6t .01 level. 



found in Table t-6 of AneerwHx r « 
A effect conditional on » (B eM A»8> effect (e). 
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Table E"» 

Two-vey ANOVAs of Three Different He«ur.. of Math Achieveeent for Math CE 
^ Ensure to Math CE in th. Preceding Year and by Cost Leveled Instructional Services* 



ft ■•* FUth CE Status 
A in 1975-1977 

D School Years (A) 



T 1 



Cost of Servicee in Categories Defined by the Mean 
end tl Standard Deviation of Costs for ct Studente (B) 



} 

Received CE 76 and 75 
Received CE 76. not 75 
Inconsistent 76 CE Dntj 
Total 

Received CI 7o and 75 
( Received CE 76. net 75 
Inconsistent 76 CC Detj 
Total 

Received CE 76 and 75 
Hccivtd CE 76, not 75 
* Inconsistent 76 CE Data 
Total 

Received CE 76 and 75 
Received CE 76. not 75 
Inconsistent 76 CE Data 
Total 

Received CE 76 and 75 
Received CE 76, not 75 
Inconsistent 76 CE Data 
Total 

Received CE 76 and 75 
Received CE 76. not 75 
C Inconsistent 76 CE Data 
Total 



High 


rflgh 
Average 


Low 
Ave rag* 


Low 


Total 


He an 


Gain in Tens 


of Standardized <z> 


ScoreC 


0.264 
0.106 
0.003 
0.134 


0.210 
•0.0)6 
•0.030 

0.068 


0.135 
0.117 
•0.038 
0.034 


•0.554 
•0.131 
•0.135 
-0.194 


0.147 
0.055 
•0.049 

0.029 


•0.108 
•0.053 
0.046 
-0.042 


0.087 
•0.054 
-0.659 
-0.001 


•0.0)1 
0.095 
0.006 
0.008 


-0.100 
•0.516 
•0.042 
•0.066 


-0.009 
0 004 
-0.011 
-P. 00* 


•0.022 
0.O73 
-0.146 
-0.006 


0.106 
0.256 
0.080 
0.126 


0.101 
0. 109 
0.014 
0.055 


0.237 
-0.182 
0.042 

0.072 


0.087 
0.131 
0.025 
0.067 


0.272 
0.205 
0.127 
0.235 


-0.025 
" 0.179 
-0.098 
-0.015 


•0.056 
-0.020 
-0 .044 
-0.044 


-0.189 
•0.445 
-0.078 
-0.121 


0.020 
0.053 
-6.049 
-0.006 


0.106 
0.221 
-0.042 
0.107 


0.070 
0.199 
-0.043 
0.056 


0.082 
0.099 
0.042 
0.066 


-0.153 
0.114 
- -0.048 
-0.060 


0.070 
0.'155 
0.004 
0.057 


0.230 
0.275 
0.028 
0.196 


0.071 
-0.082 
-0.090 
-0.015 


0.075 
0.031 
0.019 
0.040 


-0.164 
-0.462 
-0.018 
-0.062 


0.100 
0.029 
-0.004 
0.042 



ANQVA Test 
Statistics 



a|b.a*b 
a»b|a.b 



a|b.a*b 
a«b|a.b 

aIb.a-b 
a*d|a,b 

Si. 

a|b.a«b 
a»b|a.b 

It. 

a|b.a«b 
a»b]a.b 

B 

a!b 

A|B,AxB 
AxB|A.B 



4.43" 
4.60 
0.63 
1.85 

0.52 
0.04 
0.50 
1.26 

1.66 
3.07 
1.81 
0.84 

9.55*' 
0.74 
0.08 
1.48 

1.93 
4.06 
3.51 
0.85 

6.61' 
2.66 
1.30 
1.55 



Received CE 76 and 75 
Received CE 76. not 75 
Inconsistent 76 CE Data 
Total 

Received CE 76 and 75 
Received CE 76, not 75 

2 Inconsistent 76 CE Data | 
Total 

Received CE 76 and 75 
Received CT 76, not 75 

3 Inconsistent 76 CE Data | 
Tctal 

Received CE 76 end 75 
Received CE 76, not 75 j 
Inconsistent 76 CE Date 
Total 

Received CE 76 and 75 
e Received CE 76, not 75 
■ Inconsistent 76 CE Data | 

Total 

Recei/td CE 76 and 75 
Received CE 76, not 75 
Inconsistent 76 CE Data 
Total 



Received CE 76 and 75 
Received CE 76, not 75 
Inconsistent 76 CE Data 
Total 

Received CE 76 end 75 
Received CE 76, not 75 
Inconsistent 76 "E Data 
Total 

Received CE 76 and 75 
Received CE 76, not 75 
inconsistent 76 CE Data 
Total 

Received CE 76 end 75 
Received CE 76, not 75 
inconsistent 76 CE Data 
Total 

Received CE 76 and 75 
Received CE 76, not 75 
Inconsistent 76 CE Data 
Total 

Received CE 76 and 75 
Received CE 76. not 75 
1 inconsistent 76 CE Data 
Total 



Mean Residual Cain Scores Based cn the Estis>et-»d Regression 
Using Data fro* Non-CE Students Attending Non-CE Schools 

24.04 



20. 36 


18.88 


-13.53 


18.41 


4.01 


8.73 


18.38 


7.01 


5.92 


2.06 


-3.58 


1.29 


11.26 


7.76 


-2.96 


7.54 


6.68 


0.13 


1.22 


1.50 


-2.43 


9.19 


-16.3J 


3.26 


-0.83 


0.57 


-2.03 


0.28 


1.87 


1.56 


-1.52 


1.09 


26.24 


24.18 


25.62 


23.41 ' 


13.65 


5.94 


-6.29 


7.74 


-4.12 


-2.81 


-5.38 


-3.77 


13.22 


7.57 


1 .66 


8.67 


-4.14 


-4.64 


-12.08 


-0.77 


12.75 


-3.29 


-24.7! 


2.53 


-8.30 


-4.28 


-3.10 


-4.69 


-2.70 


-4.25 


-5.98 


-2.02 


5.06 


5.44 


-4.24 


4.16 


18.38 


7.29 


19.92 


13.64 


-3.64 


3.31 


-3.27 


-0.32 


4.75 


4.74 


-1.44 


4.01 


5.44 


13.60 


-7.12 


12.02 


1.94 


8.54 


-24.91 


6,94 


-7.54 


' -0.61 


-4.47 


-1.99 


-0.04 


5.30 


-5.79 


4.67 



4.88 
-7.08 
7.46 

-5.49 

0.91 

4.82 
-0.32 

16.38 

5.73 
-8.25 

9.20 

13.74 
11.10 
-1.24 
10.58 

3.30 
18.28 
-15.07 
3.61 

18.74 
16.57 
4.72 
15.52 

-•an Residual Cain Scores Based on the .Estimated Regression 

Using Date trot Non-CE Students Attending CE schools 
-18.12 11-47 
13.33 1.5* 
-7.47 '4.12 
-7.05 1-65 



aIb 

AjB.AxB 
A»B|A.B 

it. 

a]b.a«b 
a*b|a,b 

a!b 

a|b.a«b 
a»b|a.b 

a!b 

a|b.a*'j 
AsB|a. a 

B 

a|b 

a|b.a»b 

AxBjA.B 
B 

a!b 

AjB.X'B 
AxBjA. B 



5.98" 
25.65"* 
11. 31" 

3.67" 

0.45 
0.65 
0.13 

I. 95 

3.79 
73.88** 
44. 85** 

0.63 

6.08** 
1.26 
0.29 
2.04 

0.75 
8.01" 
9.23** 
1.68 

7.14** 

II. 57** 
3.19 
0.63 



16.94 


14.50 


10.75 


-1.76 


-0.43 


2.87 


-14.09 


0.01 


-3.37 


0.53 


5.66 


1.51 


-17.72 


-2.95 


-8.25 


4.85 


1.73 


13.47 


1.69 


-2.80 


*3.16 


-4.'/9 


-2.15 


-2.27 


-10.46 


-1.09 


-2.53 


-2.35 


6.36 


-1.45 


-16.21 


-7.75 


-5.98 


-8.45 


-1.96 


-4.25 


7.10 


-11.10 


-12.56 


0.54 


2.64 


-11.40 


-0.23 


-8.83 


-5.67 


4.67 


-8.10 


-8.63 


2.19 


3.35 


3.19 


17.94 


16.41 


5.73 


--17.12 


•6.15 


0.57 


2.52 


2.69 


2.36 


25.10 


11.09 


15.14 * 


11.85 


•5.24 


1.08 


•1.95 


-8.64 


•2.50 


17.43 


1.86 


4.21 



-5.01 
-19.53 
-6.63 
-6.49 

0.43 
-14.11 
•9.48 
-7.52 

-21.89 
-34.95 
-3.82 
-8.71 

-9.20 
14.74 
•9.02 
•6.94 

-4.96 
•29.61 
•4.71 
•5.81 



-7.84 
7.33 
-3.12 
-3.02 

-3.42 
0.15 
-7.41 
-4.61 

-8.17 
-6.60 
-5.69 
-6.84 

2.33 
11.96 
-3 41 

1.60 

16.17 
0.26 

-3.81 
4.7* 



AjB.AxB 

a«b!a.b 



A)B.AxB 
AxB|A. b 

B 

a|b 

AjB.AxB 
A» B| A. B 

B , 
AiB 

a!b.a«b 

AxBjA. B 

a|b.a»b 
a»b|a.b 

Mb 

AjB.AxB 
AxBjA.B 



5.08** 
22. 25** 
10.67** 

3.69** 

0.72^ 
11.41" 
2.44 
2.15 

1.73 
5.04** 
2.83 
0.75 

4.90** 
1.88 
1.12 
1.86 

1.77 
9.15** 
10. 16** 
1.66 

7.98" 
25. 50" 
10. 23" 

1.02 



%wber. of case, in each cell end in aarginals can be found in Table E-7 of Appendix E. 
-Notations, A*B - interaction effect. A|B <a|B. JUB) - A effect conditional on B (B and A*B) effctls). 
'*f-test is eignificant at .01 level. ^ 
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The Effects of Instructional Slices on Reading and Math Achievement of the First Graders 



Table F-l 



Hierarchical-Stepvige 
Selection of Predictor 
Variables for Posttest 
Achievement Scores* 



Entry 
Order* 



Correlation 
with 
Posttest . 



Standard lncre „ e 
Regression in r2 
Coefficient 



Highest Selection Level 

Pretest , 1 

Second Selection Level 

Judged Need in CE 2 

Mother's Educ. Attainment 3 

Free-Meals Participation 4 

Third Selection Level 

Type of Instructors 

Classroom Teachers 5 

(White/Minority status) 6 

Special Teachers NS 

Aides/Asst/Tutor NS 

Independent Work NS 

Multiple R 2 (R) for the Reg. Eg . 

Si2e of Instructional Group 

Approximately 7-13 S 

(White/Minority Status) NS 

14 or more NS 

Approximately 1-6 NS 

Multiple R 2 (R) for the Reg. Eg . 

Instructional Settings 

Regular Instruction 5 

(White/Minority Status) NS 

Special Instruction NS 

Tutor/ Independent NS 

Multiple R 2 (R) for the Reg. Eg . 



.66 



.533 



Partial Correlation with Posttest 
Given the Variables of Entry Orders 



1-3 1-4 1-5 1-6 



-.49 


-.196 


.038 


-.26 


- 






- 


.31 


.066 


.005 


.13 


.10 " 








-.33 


-.051 


.001 


-.11 


"-.07 


-.05 


_ 




.12 


.068 


.004 


.12 


.09 


.09 


.09 


" 


.21 


-.033 


.001 


.03 


-.01 


-.01 


-.03 


-.04 


-.20 


NS 


NS 


- .09 


- .00 




. 00 


.01 


-.16 


NS 


NS 


-.09 


-.05 


-.OS 


-.04 


-.03 


.13 


NS 


NS 


.03 


.01 


.01 


.01 


.02 




.487 


(.698) 


• 










.09 


.064 


.004 


. 10 


. 09 


■ 09 


. 09 




.21 


NS 


NS 


.03 


-.01 


-.01 


-.03 


-.03 


.06 


NS 


NS 


.05 


.02 


.02 


.02 


.03 


-.04 


NS 


NS 


-.05 


-.02 


-.01 


-.02 


.02 




.486 


(.697) 












■ 13 


.055 


.003 


. 12 


.08 


.08 


.08 




.21 


Nb 


NS 


■ 03 


-.01 


-.01 


- .03 


- .03 


-. 16 


NS 




- .09 


- .01 


-.00 


-.00 


.04 


. 11 


NS 


NS 


.02 


.00 


.00 


-.00 


.01 




.484 


(.696) 












.67 


.578 


.445 


- 










-.41 


-.140 


.023 


-.20 


- 








-.28 


-.053 


.004 


-.12 


-.08 








.27 


.037 


.001 


.10 


.06 


.05 


_ 




-.16 


-.030 


.001 


-.09 


-.04 


-.04 


-.04 


- 


.21 


NS 


NS 


.06 


.02 


-.01 


-.01 


-.01 


.01 


NS 


NS 


.05 


.03 


.03 


04 


.03 


-.12 


NS 


NS 


-.04 


.00 


.01 


.01 


.01 


.08 


NS 


NS 


.03 


.02 


.01 


.01 


.01 




.474 


(.688) 












.21 


NS 


NS 


.06 


.02 


-.01 


-.01 




.10 


NS 


NS 


.06 


.04 


.03 


.03 




-.10 


NS 


NS 


-.03 


-.00 


.01 


.01 




-.05 


NS 


NS 


-.02 


-.00 


-.00 


-.00 






.473 


(.688) 












.06 


.029 


.001 


.06 


.04 


.04 


.04 




.21 


NS 


NS 


.06 


.02 


-.01 


-.01 


-.01 


-.19 


NS * 


NS 


-.07 


-.02 


-.02 


-.01 


-.00 


.07 


NS 


NS 


.03 


.02 


.01 


.01 


.01 



.01 
.03 
.02 



Highest Selection Level 

Pretest 1 

\ Second Selection Level 

Judged Need in CE 2 

Free-Meals Participation 3 

Mother's Educ. Attainment 4 

Third Selection Level 

~ Type of Instructors 

8 Special Teachers *5 

"» (White/Minority Stajtus) NS 

? Classroom Teachers NS 

H Aides/AsstAutor NS 

jm Independent Work NS 

^ Multiple R 2 (R) for the Reg. Eg . 

o Size of Instructional Group 

*■ (White/Minority Status) NS 

* 14 or more NS 

g, Approximately 7-13 NS 

1* Approximately 1-6 NS 

5 Multiple R 2 (R) Tor the Reg. Eg. 

Instructional Settings 

Regular Instruction 5 

(White/Minority Status) NS 

Special Instruction NS 

Tutor/Independent NS 

Hultlple R 2 (R) for the Reg. Eg. 



.474 (.688) 



* The forward stepwise' selection procedure always enters the pretest score into the regression equation first. 
At the second selection level, variables describing student background characteristics are entered sequentially 
until none of thv remaining variables has a partial F-ft>r-inclusion exceeding 2.0. The background variables 
refer to race/ethnicity (1 - Caucasian/White; 9 - Non-Caucasian/White), participation in free or reduced-price 
meals (a proxy for economic status, 1 - participation; 0 - non-participation), teacher's judgment of CE need in 
the subject area (1 - need; fif ■ no need), and mother's educ **al attainment (1 * high school graduate or 
above; 9 - leas than high school). At the third level, the bJCA^round v*;i*bles not yet entered at the second 
level and a set of composite variables describing the nature and amount of instructional services received are 
involved in the selection. Again, these variables are entered into the equation sequentially until the partial 
F's for all non-entered variables are less than 2.0. Three different sets of service composites were inves- 
tigated separately. Their constructions are explained in Figure 6-1. (NS - Not Selected.) 
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Table F-2 

The Effect* of Instructional Services on Beading and Math Achievement of the Second Graders 



Hler arch lea 1-Stepwise 
Selection of Predictor 
Variables for. Post test 
Achievement Scores* 



Correlation Standard . 

_ Increase 
with Regression 4 R 2 

Posttcst coefficient 



Partial Correlation with Posttcst 
Given the Variables of;Entry Orders 



1-2 



1-3 



1-4 



1-5 



1-6 



Highest Selection Level 
Pretest 

Second Selection Levol 
Judged Need in CE 
Free-***als Pazticipation 
White/Minority Status 
Mother's Educ. Attainment 

Third Selection Level 
Type of Instructors 

Classroom Teachers 

Special Teachers 

Aides/Ass t /Tutor 

Independent Work * 

Multiple R 2 (P) for the Reg. Eg - 

Size of Instructional Group 
Approximately 7-1 t 
14 or more I 
Approximately l'-6 I 

for the Reg. Eg. 



.*0 



.660 



.636 



2 


v. 56 


-.151 


.018 


-.22 








3 


-.36 


-.066 


.011 


-.19 


-.18 






4 


.29 


.069 


.004 


.17 


.17 


1.10 




5 


.32 


.048 


.002 


.14 


.12 


.07 


.08 



NS 
NS 
NS 
NS 



jj= MultipK 



R 2 (R) 



Instructional Settings 

Regular Instruction 6 

Special Instruction NS 

Tutor/Independent NS 

Multiple R 2 (R) for the Reg. Eg . 



.10 
.29 
.16 
.18 



.05 
.09 
.04 



.15 

,26 
.16 



NS 


NS 


.05 


.04 


.04 


.04 


.04 


NS 


NS 


-.10 


-.01 


-.01 


-.01 


-.01 


"NS 


NS 


-.04 


-.01 


.00 


.01 


:oi 


NS 


NS 


.04 


.02 


.03 


.03 


.02 



.671 (.819) 



Highest Selection Level 
.Pretest Z' 

Second Selection Level 
Judged Need In CE 
other's Educ. Attainment 
White/Minority Status . 

Third Selection Level 
Type of Instructors 



.72 

-.43 
.24 
.25 



5 

i 



Classroom Teachers 


5 


.01 


Free-Meals Participation 


NS 


-.26 


Special Teachers 


NS 


-.11 


Aides/Asst/Tutor 


NS 


-.14 


Independent Work 


NS 


.08 



Multiple R (R) for the Reg. Eg . 

Size of Instructional Group 

14 or more 5 

Free-Meals Participation NS 

Approximately 7-13 NS 

Approximately 1-6 NS 

Multiple R 2 (R) for the Reg. Eg . 

Instructional Settings 
Regular Instruction 5 
Free-Meals Participation NS 

Special Instruction NS 
Tutor/ Independent NS 

Multiple R 2 (R) for the Reg. Eg . 



.10 
.26 
.12 
.04 



.04 
.26 
.16 
.07 



.050 


.002 


NS 


NS 


NS 


NS 


. 673 


( .820) * 






.039 


.002 


NS 


NS 


NS 


NS 


.672 


(.820) 


.649 


.b25 


-.127 


.016 


.062 


.004 


.036 


.001 


.060 


.004 


NS . 


NS 


NS 


NS 


NS 


NS 


NS 


NS 


.550 


(.741) 


.071 


.005 


NS 


NS 


NS 


NS 


NS 


NS 


.551 


(.742) 


.066 


.004 


NS 


NS 


NS 


NS 


NS 


NS 



.05 
.03 
.04 



.08 
.10 
.03 



.07 
.01 
-.02 



.06 
-.03 
.01 



.08 
.00 
-.02 



.07 
-.04 
.02 



.09 
.01 
.02 



.07 
.04 
.02 



.09 
.00 
.03 



.07 
.04 
.01 



.19 
.12 
.08 



.08 
.08 
.06 
.06 
.00 



.10 
.08 
.03 
.05 



.09 
.08 
.09 
.00 



.09 
.05 



.08 
-.04 
-.01 
-.02 
-.02 



.10 
-.04 
-.02 
-.04 



.10 
-.04 
-.05 
-.01 



.04 



.09 
-.02 
-.01 
-.01 
-.02 



.10 
.02 
.02 
.04 



.10 
.02 
.04 
.02 



.10 
.00 
.02 
.04 



.10 
.00 
.04 
.01 



.00 

'.01 

.00 
-.01 



.01 
.02 
.00 



.00 
.01 
.00 



.550 (.742) 



.03 
.01 



.02 
.02 



* The forward stepwise selection procedure always enters the pretest score into the regression equation first. 
At the sccom! selection level, variables describing student background characteristics are entered sequentially 
until none of the remaining variables has a partial F-for-inclusion exceeding 2.0. The background variables 
refer to race/ethnicity (1 - Caucasian/White; 0 - Non-Caucasian/White), participation in free or reduced-price 
meals (a proxy for economic status, 1 - participation; 9 - non-participation), teacher's judgment of CE need in 
the subject area (1 - need; 0 - no need), and mother's educational attainment (1 - high school graduate or 
above; 9 - ies* than high school). Afr-tfie third level, the background variables not yet entered at the second 
Jew! and a u«t of composite variables describing the nature and amount of Instructional «ervices received are 
involved in the selection. Again, these variables are entered into the equation sequentially until the partial 
F's for all non-entered variables are less than 2.0. Three different sets of service composites were inves- 
tigated separately. Their constructions are explained in Figure 6-1. 



(NS - Not Selected.) 
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T«bl« F-3 

The Effects of Instructional* Services on Reading .and Math Achievement of the Third Graders 



Hierarchical-Stepwise 
Selection of Predictor 
Variables fcTr ppsttest 
Achievement Scores* 



Entry 
Order* 



^Correlation 
with 
Post test 



Standard 

. Increase 
Regression . ft 2 
Coefficient 



Partial Correlation with Posttest 
Given the variables of Entry Orders 



1-2 1-3 1-4 1-5 1-6 1-7 



HighJtt Selection Level 
Pretest 

Second Selection Level 
Judged Need in CE 
Mother's Educ. Attainment 
White/Minority Status 
Free-Meals Participation 

third Selection Level 
Type of Instructors 

Special Teachers 

Classroom Teachers 

Aides/Asst/Tutor 

Independent Work 

Multiple R 2 (R) for the Reg. Eg . 

Sire of Instructional Croup 
Approximately 7-1 3 
14 or no re 
Approximately 1-6 

Multiple R 2 <R) for the Reg. Eg . 

Instructional Settings 
special Instruction 
Regular Instruction 
Tutor/Independent 
2 

Multiple R (R) for the Reg. Eg . 



1 


.64 


.715 




.707 












2 


- .60 


- . 100' 




010 


- » 19 










3 


.36 


.060 




.004 


.14 


.13 


_ 






4 


.37 


.045 




v .003 


.12 


.10 


.10 








- . 39 


- .041 


* 


.001 


-.13 


-.12 


-.09 


-.06 




6 


-.34 


-.033 




.001 


-.10 


• 

-.04 


-.05 


-.05 


-.05 


NS 


.01 


NS 




NS 


-.04 


-.04 


-.03 


- .03 


-.03 


NS 


-.24 


NS 




NS 


-.06 


-.01 


-.00 


-.00 


.00 


NS 


.13 


NS 




NS 


.02 


.01 




$01 


.01 






.727 


(.852) 














6 


-.06 


r- -.026 




."01 


-.08 


-,.06 


-.05 


-.05 


-.05 


NS 


.06 


NS 




NS 


.03 


.01 


.01 


.01 


.02 


NS 


-. 10 


NS 




NS 


- .03 


-.00 


- .01 


-.01 


- .02 






.726 


(.852) 














6 


-.31 


-.036 




.001 


-.09 


-.03 


-.04 


-.04 


-.04 


7 


.07 


-.023 




< .001 


-.02 


-.03 


-.02 


-.02 


-.02 


NS 


.11 


NS 




NS 


.02 


.01 


.00 


\01 


.01 






.727 


( .853) 














1 


.73 


.613 




.538 


* * 










2 


-.51 


-.166 




.027 


- . 24 










3 


. 31 


.068 




.007 


. 17 












- . 32 


-.060 




.003 


-.15 


-.12 


-.08 


_ 




5 


. 12 


.062 




.001 


.08 


.07 


.06 


.06 


- 


6 


.01 


.052 




.002 


.03 


.02 


.04 


.04 


.07 


7 


- .13 


.033 




.001 


-.04 


.03 


.04 


fOA 


.05 


NS 


.24 


NS 




NS 


.10 


.06 


.05 


.03 


.03 


NS 


-.17 


NS 




NS 


- .07 


-.02 


- .02 


- .01 


— .01 






.579 


(.761) 














S 


.08 


.079 




.002 


.09 


.07 


.07 


.08 




6 


-.01 


.055 




.002 


.01 


.03 


.02 


.02 


.07 


KS 


.24 


NS 




NS 


.10 


.06 


.05 


.03 


.03 


NS 


-.07 


NS 




NS 


-.07 


-.04 


-,02 


-9 2 


.01 






.579 


(.761) 


































5 


.06 


.067 




.002 


.05 


.05 


.06 


.06 




6 


.12 


.063 




.003 


.07 


.06 


.05 


.05 


.09 


NS 


.24 


■ NS 




NS 


.10 


.06 


.05 


.03 


.03 


NS 




NS 




NS 


-.09 


-".03 


-.02 


-.02 


.01 



-.04 
-.00 
.00 



.00 
-.03 



-.04 
.01 



Highest Selection Level 
Pretest 

Second Selection Level 
Judged Need in CE 
White/Minority Status 
Free-Meals Participation 

Third Selection Level 
Type of Instructors 

Independent Work 

Classroom Teachers 

Special Teachers 
(Mother's Educ. Attainment ) 

Aides/Asst/Tutor 

Multiple R 2 4R) for the Reg. Eg , 

Size of Instructional Croup 
14 or more 
Approximately 1-6 
(Mother's Educ. Attainment) 
Approximately 7-13 

Multiple R 2 (R) for the Reg. Eg 

Instructional Settings 
Regular Instruction 
Tutor/I r dependent 
(Mather's Educ. Attainment) 
Special Instruction 

Multiple R 2 (R) for the Reg. Eg. 



.05 
.03 
.00 



.03 
.04 



.03 
.02 



.579 (.761) 



The forward stepwise selection procedure always enters the pretest score into the regression equation first. 
At the second selection level, variables describing student background characteristics are entered sequentially 
ontil none of the remaining variables has a partial P-for-inclusion exceeding 2.0. The background variables 
refer to race/ethnicity (1 ■ Caucasian/White j 9 ■ Non-Caucasian/White), participation in free or reduced-pr.ee 
meals (a proxy for economic status. 1 ■ participation t 0 ■ non-participation), teacher's judgment of CE need in 
the subject area (1 • needi 9 ■ no need), and mother's educational attainment (1 ■ high school graduate or 
above; 9 ■ less than high school). ^At the third level, the backgrou.id variables not yet entered at the second 
level and a set of composite variables describing the nature and amount of instructional services received are 
involved in the selection. Again, thes/> variables are entered into the equation sequentially until the partial 
P»s for all non-entered variables are less than 2.0. Three different sets of service composites were inves- 
tigated separately. Their constructions are explained in Figure 6-1. (NS - Not Selected.) 



.03 
.00 
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Table F-4 

The Effects of Instruction*! Services on Reading and Math Achieveoent of the Foirth Cradera 



Hierarchical -Stepwise 
Selection of Pied let or 
Variables for Post test 
Achievement Scores* 



Entry 
Order* 



Correlation 
with 
Posttest 



Standard 
Regression 
Coefficient 



Increase 

in R 2 



Hi ghest Selection Level 
5 Pretest 

« Second Selection Level 
7 Judged Need in CE 
z Mother's Educ. Attainment 
"1 White/Minority Status 

~ Third Selection Level 
« Type of Instructors' * 

* (Free-Meals Participation) 

u t Cl an room Teachers • 
"2 special Teachers x * 

• Aides/Asst/Tutor 
■ independent Work 
2* 2 

I Multiple R <R) for the Reg. Eg . 

Site of Instructional Croup 
(Free-Meals Participation) 
14 or sore 
Approximately 7-13 
Approxiaately 1-6 

Multiple R 2 <R) for the Reg. Eg . 

Instructional Settings 
(Free-Meals Participation) 
Regular Instruction 
Special Instruction 
Tutor/ Independent 

Multiple P 2 (R) for* the Reg. Eg . 



1 


.66 


.810 


.769 


2 


-.58 


•.079 


.005 


3 


.33 


.03? 


.001 


4 


.32 


.024 


* '.001 



KS« 

MS 

NS 

NS 

NS 



.36 
.0U 
.35 
.20 
■ P4 



NS 
NS 
NS 
NS y 
NS 



NS 


-.06 


-.05 


-.03 


-.02 


NS 


-.00 


-.00 


.00 


.01* 


NS 


-.05 


-.01 


-.00 


-.01 


NS 


.00 


.02 


.03 


.03 


NS 


-.01 


-.01 


-.*bi 


-.01 



Highest, Selection Love! 
Pretest 

Second Selection Level 
Free-Meals Participation 
Judged Need in CE 
Mother's Educ. Attainment 

Third Selection Level 

Type of instructors 
£ Special„Tcachers 
« Classroom Teachers 
<y (White/Minority Status) 
5 Independent Work 
Aides/Asst /Tutor 

£ Multiple R (R) for the Reg. Eg- 
£ Size of Instructional Group 
14 or more 

• Approximately 7-1 3 

* Approximately 1-6 
5 {White/Minority Status) 

5 Multiple R 2 <R) for the tog. Eg . 

Instructional Settings 
Special Instruction 
Regular Instruction 
(White/Minority Status) 
Tutor/Independent 

Multiple R 2 (R> for the Reg. Eg . 



NS 


-.36 


NS „ 


NS 


KS 


.10 


NS 


NS 


NS 


-.10 


NS 


NS 


NS 


-.19 


NS 


NS 




* 


.776 


(.881) 


KS 


-.36 


NS 


NS 


NS 


.08 


NS 


NS 


NS 


-.3? 


NS 


NS • 


ss 


.04 


NS 


NS 






.776 


(.681) 


1 


m 


.698 


*\ 
.593 


2 


-.31 


r .064 


.008 


3 


-.45 


-.090 


.004 


4 


.28 


.054 


.002 


5 


-.11 


.073 


* 

.003 


6 


-.01 


.068 


.002 




.25 


.028 


.001 


s 


.04 


.042 


.001 


ns 


-.17 


NS 


NS 






.613 


(.783) 








t 


5 


.06 


.083 


.001 


C 


-.08 


.059 


.001 


7 


-.08 


.0^3 


.001 


P 


.25 


.030 


.001 


/ 




.611 


(.782) 


5 


-.18 


.065 


.001 


6 


.03 


!056 


.002 


7 


.25 


.032 


.001 


NS 


.03 


NS 


NS 



.611 (-782) 



Partial Correlation with Posttest 
Given the Variables of Entry Orders 



1-2 1-3 



1-5" 1-6 1-7 1-8 



.14 
.09 
.06 



.07 
.05 



-.05 
.03 
-.03 
-.01 



.06 -.05 
.02 .02 
.07 -.03 
.0u -.01 



•.03 
.03 
.02 

-.01 



.03 
.02 
.03 
.01 



.02 - 
".01 



-.02 

.(ft- 
-.03 
-.01 



-.14 
.12 



.04 
.03 
.08 
.00 
-.04 



.04 
.00 
• .01 
.0$ 



. 10 

.08 



.05 
.05 
.04 
-.00 
•.04 



.08 *■ 
.05 
.0? 
.00 
-.03 



, .*08 
.OS 
.03 
-.00 
-.02 



/ 

.06 
.03 
.01 
-.02 



.04 
.06 
- 01 



.06 
-.01 



.OS 
.02 
-.01 

.04 




atanwic* selection procedure always enters the pretest, score into the 
It tnHectnJ .Ee£i" lV,eT. SaSabut describing student background characteristic, are entered sequentially 
untii none Sf th^e^ning variable? his a partial F-for inclusion exceeding 2.0. The background variables 
refer to race/ethnicity (1 • Caucasian/Whit., 0 - Non-Caucasian/WhXte> , participation in free or reduced-price 
ZM U proxy f« economic status, 1 - participation, d - non-participation), teacher*, judgment of CE need in 
^ubjec^re I™d' 9 - no needed other's educational attainment (1 * high school graduate or 
above, I - less than high school). At the third level, the bicfcgrotmd v*ri*bl*s not ye eneered at eh* second 
and a set of composite variables describing the nature and amount of instructional services rccei ved are 
invllvtd in the selection. Again, "these variables are entered into the equation sequentially until the partial 
F*s for an non-entered Car i 2l es are less than 2.0. Thr*e different sets of service composites were inves- 
tlgated separately. Their constructions are explained in Figure 6-1. (MS - Not Selected.) 
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Table F-5 

The Effects of Instructional Services on Reading and Math Achievement of the Fxfth Graders 



Hierarchical-Stepvise 
Selection of Predictor 
Variables for Posttest 
Achievement Scores* 



Correlation Standard _ 

Entry. , „. _ Increase 

Order* with Agression r2 

- Posttest Coefficient 



Partial Correlation with Posttest 
Given the Variables of Entry Or-mrs 



Pretest 
Second Selection Level 


1 


.89 


Free-Meals Participation 


2 


.47 


Judged Need in" CE 


3 


-.56 


Mother's Educ. Attainment 


4 


.35 


Third Selection Level „ 






Type of Instructors 






Indeperdent work 


5 


.05 


(White/Minority Status) 


NS 


.40 


Classroom Teachers 


NS 


-.05 


Special Teachers 


NS 


-.29 


Aid e s /Ass t /Tut or 


NS 


- 16 



.825 



-.084 


.007 


-.19 










-.044 


.001 


-.11 


-.09 








.019 


< .001 


.09 


.05 


.04 







Multiple iTfpl for the Rcu. Eg . 

Size of Instructional Group 
(White/Minority Status) 
14 or more 
Approximately 7-13 
Approximately 1-6 

v. Xultiplc R (R) for the Reg. Eg , 

Instructional Settings 

Tutor/Independent 
(White/Minority Status) 
Regular Instruction 
Special Instruction 

Multiple R 2 (R) for the Reg. Eg . 



.017 


< .001 


.04 


.04 


.04 


.04 




NS 


NS 


.10 


.03 


.03 


.03 


.03 


NS 


NS 


-.03 


-.01 


-.01 


-.01 


.00 


NS 


NS 


-.04 


-.04 


-.02 


-.02 


-.02 


NS 


NS 


-.02 


.00 


.02 


.02 


.02 


.C09 


(.899) 













NS 
NS 
NS 

,-NS 



.40 
.06 
.15 
.12 



NS 
NS 
NS 
NS 

.809 (.899) 



.10 
.00 
.03 
.00 



.03 
.02 
.02 
.01 



.03 
.01 
-.01 
.02 



.03 
.01 
-.01 
.01 



i 


.05 


.018 


< .001 






. 04 


.04 






NS 


.40 


NS 


NS 


.10 


.03 


.03 


.03 


.03 




NS 


-.00 


NS 


NS 


-.01 


.01 


.00 


.00 


.02 




NS 


-.27 


NS 


NS 


-,05 


-.04 


-.02 


-,02 


-.02 








.809 


(.899) 














1 


.81 


.750 


.655 














2 


-.38 


-.047 


.005 


-.12 












3 


-.47 


-.052 


.002 


-.11 


-.08 










4 


.33 


.046 


.001 


.11 


.06 


.06 








5 


.00 


032 


.001 


.05 


.05 


.05 


.05 






NS 


.28 


NS 


NS 


.07 


.04 


.03 


.04 


.03 




NS 


-.11 


NS 


NS 


-.02 


-.01 


.00 


.00 


.01 




NS 


-.14 


NS 


NS 


-.03 


-.02 


-.01 


-.00 


.01 




Vt 


.02 


NS 


NS 


-.01 


-.01 


-.01 


-.01 


.03 








.665 


(.815) 














5 


.11 


.082 


.003 


.10 


.10 


.10 


.10 






6 


-.12 


.038 


.001 


-.04 


-.04 


-.04 


-.03 


.05 




NS 


.28 


NS 


NS 


.07 


.04 


.03 


.04 


.03 


.03 


NS 


-.11 


NS 


NS 


-.07 


-.06 


-.06 


-.06 


-.02 


.00 






.668 


.817) 














5 


.06 


.037 


.001 


.06 


.06 


.06 


.06 






H£ 


.28 


NS 


NS 


.07 


.04 


.03 


.04 


.03 




NS 


-.19 


NS 


NS 


-.05 


- 04 


-.03 


-.02 


.01 




NS 


.02 


NS 


NS 


-.01 


-.01 


-.01 


-.01 


.03 








.665 ( 


.816) 















Highest Selection Level 
Pretest 

Second Selection Level 
Free-Meals Participation 
Judged Need in CE 
White/Minority Status 

Third Selection Level 

Type of Instructors 
^ ClassioflB Teachers 
£ (Mother WEduc . Attainment) 
m m Special Teachers 
7 Aides/Asst/TAitor 
5 Independent work 

■fj Multiple R (R) for the Reg. Eg . 

^ Size of Instructional Group 

q > 14 or more 
*** \ Approximately 1-6 
£ ^Mother's Educ Attainment) 
5, Approximately 7-13 

| Multiple R 2 (R) for the Reg. Eg . 
Instructional Settings 
Regular Instruction 
(Mother's Educ. Attainment) 
Special Instruction 
Tutor/Independent 

Multiple R 2 (R) for the Reg. Eg . 



The forward stepwise selection procedure always enters the pretest score into the regression equation first. 
At the second selection level, variables describing student background characteristics are entered sequentially 
until none of tne remaining variables has a partial F-for-inclusion exceeding 2.0. The background variables 
refer to race/ethnicity (1 - Caucasian/White: 9 ' Non-Caucasian/White) , participation in fiee or reduced-price 
meals (a proxy for economic status,, 1 - participation: 0 ■ non-participation) , teacher's judgment of CE need in 
the subject area (1 ■ need; <? ■ no need)* and mother's educational attainment (1 * high school graduate or 
above; 0 - less than high school). At the third level, the background variables not yet entered at the second 
level and a set of composite variables describing the nature and amount of instructional services received are 
involved .n the selection. Again, these v iables aro entered into the equation sequentially until the partial 
P's for all non-entered variables are less than 2.0. ThreA different sets of service composites were inves- 
tigated separately. Their constructions are explained in Figure 6-1. (NS - Not Selected.) 
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Table F-6 

The Effects of Instructional Services on Reading and Math Achievement of the Sixth Graders 



Hierarchical-Stepwise 
Selection of Predictor 
Variables for Posttest 
Achievement Stores* 



Entry 
Order* 



Correlation 
with 
Posttest 



Standard 
Regression r2 
Coefficient 



Highest Selection Level 
Pretest 

» 

Second Selection Level 
Judged Need in CE 
Mother's Educ. Attainment 
White/Minority Status 

Third Selection Level 
3 Type of Instructors 

Independent Work 
£ Special Teachers 
£ (Free-Meals Participation) 
w Classroom Teachers 
«T Aides/Asst/Tutor 

5 Multiple R 2 (R) for the Reg. Eg . 

^ Size of Instructional Group 

£ (Free-Meals Participation) 

** 14 or more 

™ Approximately 7-13 

* Approximately 1-6 

Multiple R 2 (R) for the Reg. Eg . 

hstructional Settings 
Tutor/Independent 
(Free-Meals Participation) 
Regular Instruction 
Special Instruction 

Multiple R 2 (R) for the Reg. Eg . 



1 

4 

2 
3 
4 



.58 
.36 
.37 



.067 
.043 
.041 



.004 
.002 
.001 



5 


.02 


.022 


.001 


.06 


.04 


.04 


.05 






6 


-.31 


-.017 


<.001 


-.08 


-.04 


-.04 


-.04 


-.04 




NS 


-.38 


NS 


NS 


-.07 


-.06 


-.04 


-.01 


-.02 


-.01 


NS 


.02 


NS 


NS 


.00 


.01 


.00 


.01 


.03 


.02 


NS 


-.22 


NS 


NS 


-.02 


.00 


.01 


.02 


.02 


.02 






.817 


(.904) 















3 — 



NS 


-.38 


NS 


NS 


-.07 


-.06 


-.04 


-.01 


NS 


.13 


NS 


NS 


.01 


.00 


-.00 


-.00 


NS 


-.18 


NS 


NS 


-.01 


.00 


.00 


.01 


NS 


-.16 


NS 


NS 


.01 


.02 


.02 


.03 






.816 


(.903) 











Partial Correlation with Posttest 
Given fche Variables of Entry Orders 



1-5 



.15 
.11 
.09 



.10 
.09 



5 


.01 


.025 


.001 


.06 


.04 


.04 


.06 




NS 


-.38 


NS 


NS 


-.07 


-.06 


-.04 


-.01 


-.02 


NS 


.07 


NS 


NS 


.01 


.01 


.01 


.01 


.03 


NS 


-.33 


NS 


NS 


-.07 


-.04 


-.04 


-.03 


-.03 






.817 


(.904) 












1 


.82 


.755 


.679 












2 


.29 


.059 


.005 


.12 










3 


-.48 


-.071 


.004 


-.12 


-.11 








4 


-.31 


-.029 


.001 


-.10 


-.07 


-.07 






5 


.27 


.027 


.001 


.08 


.07 


.07 


.04 




NS 


.04 


NS 


NS 


.00 


.00 


.01 


.01 


.01 


NS 


-.16 


NS 


NS 


- 05 


-.05 


-.03 


-.03 


-.02 


NS 


-.17 


NS 


NS 


-.01 


-.00 


.01 


.02 


.02 


NS 


.04 


NS 


NS 


.02 


.02 


.01 


.01 


.01 






.690 


( 831) 












NS 


.11 


NS 


NS 


-.00 


-.01 


-.01 


-.01 


-.01 


NS 


-.08 


* NS 


NS 


.01 


.00 


.02 


.02 


.03 


NS 


-.09 


NS 


NS 


-.01 


-.00 


.00 


.01 


.01 






.690 


(831) 












NS 


.08 


NS 


NS 


.01 


.01 


.01 


.01 


.01 


NS 


-.21 


NS 


NS 


-.05 


-.04 


-.02 


-.02 


-.01 


NS 


.03 


NS 


NS 


.02 


.02 


.01 


.01 


.02 


■ 




.690 


(.831) 































Highest Selection Level 
Pretest 

Second Selection Level 

Mother's Educ. Attainment 
Judged Need xn CE 
Free-Weals Participation 
White/Minority Status 

Third Selection Level 
Type of Instructors 

Classroom Teachers 

Special Teachers 

Aides/Asst /Tutor 

Independent Work 

Multiple R 2 (R) for the Reg. Eg . 

Size of Instructional Group 
14 or more 
Approximately 7-13 
Approximately 1-6 

Multiple R 2 (R) for the Reg. Eg . 

Instructional Settings 
Regular Instruction 
Special Instruction 
Tuto r/ 1 n de oe nde nt 



The forward stepwise selection procedure always enters the pretest score into the regression equation first 
At the second selection level, variables describing student background characteristics are entered sequentially 
until none of the remaining variables has a partial F-for-inclusion exceeding 2.0. The background variables 
refer to race/ethnicity (1 - Caucasian/White; 0 * Non-Caucasian/Whitc) , participation in free or -cduced-price 
oeals (a proxy for economic status, 1 - participation; 0 - non-participation), teacher's judgment of CE need in 
the subject area (1- need* 0 - no need), and mother's educational attainment (1 * high school graduate or 
above; 0 - less than high school). At the third level, t/ic background variables not yet entered at the second 
level and a set of composite variables describing the nature and amount of instructional services received arc 
involved in the selection. Again, these variables are entered into the equation sequentially until the partial 
F # «* for all non-entered variables are less than 2.0. Three different sets of service composites were inves- 
tigated separately. Their constructions aro explained in Figure 6-). (NS « Not Selected.) 
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Table F-7 

Correlations of Student-Background Variables and Education-Process Variables with Posttest Achievement Scores 
(Based on 15\ Random Samples from Each Grade from the First-Year SES Data Base) 



Background Variables and 
Variab'ljes Oescribmg the 
Educational Processes* 



Grade 
N » 



Background Variables 
Pretest VSS Score 
White/Minority Status 
Free-Meals Participation 
Teacher's Judgment of CE Need 
Mother's Educational Attainment 



Characteristics of Instructional Personnel 
Staff /Student Ratio 
SupportAeachmg Personnel Ratio 
Years of Teaching 
Highest Degree Earned , 
Recent Inservice Training 
Belief m Schooling 
Attitude to School Programs 



Reading Achievement Posttest 



1,478 1,390 1,394 1,338 1,433 1,596 



.66 


.80 


.84 


.88 


.89 


.90 


,67 


.72 


.73 


.77 


.81 


.82 


.21 


.29 


.37 


.32 


.40 


.37 


.21 


.25 


.31 


.25 


.33 


.27 


-.33 


-.36 


-.39 


-.36 


-.47 


-.38 


-.28 


-.26 


-.32 


-.31 


-.38 


-.31 


-.49 


-.56 


-.60 


-.58 


-.56 


-.58 


-.41 


-.43 


-.51 


-.45 


-.47 


-.48 


.31 


.32 


.36 


.33 


.35 


.36 


.27 


.24 


.24 


.28 


.28 


.29 



Characteristics of Educational Environment 
School's Minority Concentration 
School's Poverty concentration 
School's CE Concentration 
School's Low-Achiever Concentration 
School's Central Resources 
Student Mobility Rate 
Parent /Cowaunity Involvement 
District Control of Instruction 
Principal's Instructional Leadership 
Teacher's Involvement in Decisions 
Disturbance of Instruction 
^District's Testing Program 



Characteristics of Educational Practices 
Effort *n Curriculum Development 
Effort in Planning and Evaluation 
Teacher's Use of Lesson Plans 
Frequency of Feedback per Senester 
Weekly Homework Assigned 
Monthly Use of Materials 
Individualization of Instruction 
Monthly Use of Audio-Visual Equipment 



Characteristics of Classroom Organization 
Classroom Achievement Level 
Extent of Ability Grouping 
Class Size 



Math Achievement Posttest 



1 



1,430 1,375 1,360 1,287 1,375 1,553 





-.05 


-.09 


-.03 


-.09 




05 




04 


-.00 




03 




00 




06 


-.03 




04 




.00 


- .02 


-.01 


-.06 




04 




00 


-.03 




01 


- 


01 




01 


-.01 


- 


02 




. 12 


.12 


.08 


.15 




08 




07 


.07 




14 




08 




15 


.05 




10 




-.03 


-.05 


-.07 


-.03 


„ 


04 


_ 


04 


-.05 


_ 


03 


- 


04 


- 


08 


.00 




02 




-.01 


-.11 


-.11 


-.19 


m 


07 


m 


09 


-.03 


_ 


02 


- 


06 




01 


.00 




01 




-.03 


- .07 


-.07 


-.04 


m 


02 




02 


.01 


_ 


04 




01 


- 


02 


-.03 


- 


05 




.10 


.06 


.10 


.04 




10 




19 


.10 




06 




09 


- 


01 


.11 




.13 




-.18 


-.28 


-.37 


-.25 


- 


35 


- 


35 


-.19 


- 


23 




34 


: 


21 


-.31 




- 

26 




-.27 


-.33 


-.43 


-.34 




40 




38 


-.26 




27 




39 




.29 


-.35 




.29 




-.13 


-.21 


-.27 


-.20 


_ 


15 


_ 


.23 


-.10 


- 


.15 


- 


.19 


- 


.19 


-.10 


- 


.13 




-.35 


-.39 


-.51 


-.40 


- 


.47 


- 


.44 


-.32 




.34 




.48 




.35 


-.44 




.36 




.06 


.01 


.07 


-.02 




.02 




.00 


.02 




.04 




.01 


- 


.03 


-.02 


- 


.05 




-.08 


-.04 


-.13 


-.06 




.09 




.06 


- .06 




.07 




. 1 2 










. 09 




-.11 


-.12 


-.15 


-.09 




.02 




.10 


-.11 




.09 




.16 




.10 


-.03 




.11 




.00 


-.07 


.01 


-.06 




.07 




.05 


- .01 




.05 




.00 




.04 


-.07 




.02 




.07 


-.05 


-.04 


-.05 




.00 




.05 


-.01 




.01 




.07 




.08 


.00 




.05 




.02 


-.03 


-.03 


-.03 




.02 




.03 


.01 




.03 




.03 




.09 


.01 




.04 




-.08 


-.12 


-.21 


-.13 




.22 




.18 


-.11 




.11 




.19 




.13 


-.22 




.16 




-.00 


-.04 


-.02 


.00 




.01 




.05 


-.01 




.03 




.04 




.01 


.04 




.00 


iff 


- 06 


-.05 


-.01 


-,02 




.05 




.06 


-.05 




.00 




.00 




.03 


-.07 




.07 




.00 


-.06 


-.07 


-.10 




07 




.12 


-.02 




.00 




.05 




.08 


-.09 




05 




.09 


-.03 


.03 


-.04 




.01 




.11 


.02 




.02 




.03 




.02 


-.08 
.06 




.01 




.09 


.04 


.12 


.06 




.01 




.04 


-.03 




.01 




.09 




.04 




.03 




.06 


.07 


-.01 


-.05 




.01 




.07 


07 




.08 




.05 




.06 


.02 




.04 




-.02 


.03 


-.06 


.00 




.01 




.08 


-.02 




.03 




.05 




.08 


.00 




.14 




.06 


.06 


.10 


.05 




.01 




.07 


-.01 




.09 




.05 




.09 


-.08 




.02 




-.07 


-.06 


-.17 


-.11 




.20 




.14 


-.07 




.06 




.13 




.11 


-.12 




.04 




.01 


-.07 


-.17 


-.18 




.20 




.21 


-.08 




.03 




.02 




.08 


-.06 




.08 




-.01 


.02 


-.04 


-.01 




.01 




.06 


-.02 




.04 




.06 




.02 


-.01 




.05 




-.02 


.01 


.00 


-.04 




.04 




.01 


-.00 




.01 




.01 




.04 


-.02 




.01 




-.01 


.05 


.07 


.14 




.11 




.15 


.02 




.02 




.05 




.06 


.01 




.08 



"when applicable. Process variables specify to reading instruction are correlated with reading posttest scoes and those 
specific to math instructs with *ath posttest scores. Some variables haye been aggregated to school levels The 
following categorical variables have been specifically coded. for the correlationa analyses: "™ Z 

(0 - So Need of CE in subject area. 1 - Need CE m subject area). School's Central Resources (0 - no resource center in 
ubiect area, 1 • Presence of resource center in subject area); Teacher's Use of lesson P ans (0 - lesson *™£J**« 
area are not used. 1 - lesson Plans m subject area are used), Classroom Achievement Level (0 - homogeneous achievement 
level m subject area, 1 • heterogeneous achievement levels in subject area). 
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Table F-8 



Effects of Characteristics of Instructional Personnel on Student Achievement, Adjusted for Differences in Student 
Background Characteristics (Based on 15% Random Samples from Bach Grade from the Fir<tt-Year SES Data Base) 



Selected Student Background 
Variables and Characteristics 
of Instructional Personnel 

for the Prediction of 
Achievement Posttest Score* 



Pretest Score 
6 Free-Meals Participation 
R Teacher's Judgment of CE Need 
A Mother's Educational Attainment 

0 Support/Teaching Personnel Ratio 
£ Years of Teaching 

Recent Inservice Training 

1 Belief m Schooling 

. Attitude to School Programs 

R*(R) for the Regression Model 



Regression Model for Predicting 
Reading Posttest "core 



Entry 
Order 



Standardized Increment 

Regression in R J in Tolerance 
' Coefficient Sequence 



1 


.523 


.438 




1 


.582 


.445 




4 


-.040 


,001 


.783 


3 


-.055 


.004 


.875 


2 


-.205 


.038 


.774 


2 


-.150 


.02 3 


.830 


3 


.070 


.005 


.871 


4 


.036 


.001 


.826 


7 


.033 


<.001 


.992 


NA 








5 


.064 


<.001 ' 


.992 


5 


.038 


.002 


.993 


6 


.051 
.028 


<.001 


.976 


7 


.040 


.002 


.977 


NA 
8 


<.001 


.979 


6 

NA 


.041 


.002 


.996 



.490 (.700) 



Regression Model for Predicting 
Math Posttest Score 



Entry 



Standard* zed Increment 

Regression in R * in Tolerance 
* Coef f icient Sequence 



.478 (.691) 



Pretest Score 
G White/Minority Status 
R Free-Meals Participation 
A Teacher's Judgment of CE Need 
D Mother's Educational Attainment 
E Years of Teaching 

Belief m Schooling 
2 Attitude to School Programs 
D 2/ 



1 


.660 


.636 




1 


.642 


.525 




4 


.068 


.004 


.776 


4 


.021 


.001 


.888 


3 


-.061 


.011 


.893 


NA 








2 


-.149 


.018 


.680 


2 


-.132 


.016 


.811 


5 


.050 


.002 


.823 


3 


.060 


.004 


.926 


6 


.042 


.001 


.977 


5 


.094 


.009 


.982 


8 


-.024 


.001 


.990 


NA 








7 


-.027 


.001 


.943 


NA 









R*(R) for the Regression Model 



.555 (.745) 



Pretest Sc6re 
White/Minor i ty Status 
Free-Meals Participation 
TeacheX's Judgment of CE Need 
Mother's Educational Attainment 
Staff/Student Ratio 
Years of Teaching 
Highest Degree Earned 
Recent Inservice Tramirg 

R 2 (R) for the Regression Model 



Pretest Score 

White/Minority Status 

Free-Meals Participation 

Teacher's Judgment of CF Need 

Mother's Educational Attainment 

Years of Teaching 

Recent Inservice Training 

R 2 (P) for the Pegression Model 



Pretest Score 
White/Minority Status 
Free-Meals Participation 
Teacher's Judgment of CE Seed 
Mother's Educational Attainment 
Support /Teaching Personnel Ratio 
Years of Teaching 
Highest Degree Earned 
Attitude to School Prograns 

R 2 (R> for the Regression Model 



Pretest Score 
White/Minority Status 
Free-Meals Participation 
Teacher's Judgment of CE Need 
Mother's Educational Attainment 
Support/Teaching Personnel Ratio 
Years of Teaching 
Recent Inservice Training 
Belief m Schooling 

R 2 (P) for the Regression Model 



1 


.715 


.707 




1 


.612 


.*38 




4 


.040 


.00 3 


.857 


3 


.053 


.007 


.877 


5 


-.046 


.001 


.702 


4 


-.066 


.003 


.775 


2 


-.118 


.010 


.610 


2 


- . 1* 


.027 


.750 


3 


.057 


.004 


.8V5 


NA 








8 


.028 


.001 


.955 




.031 


.001 


.961 


6 


.031 


.001 


.992 


6 


.037 


001 


.986 


9 


.024 


.001 


.957 


NA 








7 


-.029 


.001 


.977 


5 


-.045 


.002 


.'388 



.729 (.854) 



.578 (.761) 



1 


.806 


.769 




1 




A 


.024 


<.001 


.886 


NA 




NA 








2 




2 


-.078 


.005 


644 


1 




3 


.037 


.001 


.876 


4 




5 


.033 


.001 


.981 


5 




NA 








6 





.694 

.066 
.075 
.051 
.043 
.031 



.593 

008 
.004 
.002 
.002 
.001 



.777 (.801) 



.610 (.781) 



1 

NA 
2 
3 
4 

NA 
5 



.083 
.Q46 
.022 



.POO 

.007 
.001 

< 001 

.001 



.809 
.651 
.833 

.992 



.810 (.900) 



NA 
2 
3 
7 

NA 
5 
6 



.826 
.046 

.080 
.040 
.018 

.031 
.021 



.809 
.001 

.004 
.002 
<.< 01 

.001 
<.001 



.860 

.663 
.868 
.981 

.952 
.992 



.818 (.904* 



.747 
.039 
.036 
.053 
.026 
.026 
.025 
.031 
.033 



.655 
.001 
.005 
.002 
< .001 
.001 
.001 
.001 
.001 



.668 (.817) 



.694 (.833) 



.915 
.734 
.844 
.978 
.993 



.715 
.850 
.704 
.852 
.974 
.914 
.988 
.967 



1 


.753 


.679 




5 


.029 


001 


.742 


4 


-.020 


.001 


,833 


3 


-.075 


.004 


.733 


2 


.055 


.005 


.924 


6 


-.045 


.001 


.985 


7 


.043 


.001 


.948 


NA 








8 


-.040 


.002 


.975 



Variables describing student's background and characteristics of instructional personnel that were employed as POtenti ftl 
predictors 7re given m Table F-7. A criterion of 2.0 for the 'partial F-to-enter' was used for the selection of the 
predictors are given in iwie /■ .Meetion Procedure, background variables (the first listed) 
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Table F-9 



Effect, of Characteristics of the Educational Environment on Student Achievement, Adjusted for Difference* in Student 
Lckground Characteristic. (Bated on 15% Random Sample, fron Each Crade from the Fir.t-Year SES Data Base) 



Selected Student Background 
Variable, and Characteristic, 
of Educational Environment 

for the Prediction of 
Achievement Postte.t Score* 



Pretest Score 

Frse-xeals Participation 

Teacher's Judgment of CF Need 
G Mother's Educational Attainment 
R School's Minority Concentration 
A School's CE Concentration 
D School's Low-Achiever Concentration 
E School's Central Resources 

Parent/Coaounity Involvement 
1 District Control of Instruction 

Principal's Instructional Leadership 

Disturbance of Instruction 

R ? (R).for the Regression Model 



Regression Model for Predicting 
Reading Postte.t Score 



Standardized Increment 
Entry Regression in R 2 in Tolerance 
° rd * r * Coefficient Sequence 



1 


.524 


.438 




4 


-.063 


.001 


.783 


2 


-.218 


.038 


.774 


3 


.068 


.005 


.871 


NA 








5 


.065 


.004 


.851 


NA 








9 


.039 


.001 


.900 


6 


-.092 


.003 


.896 


10 


.029 


.001 


.965 


7 


.056 


.005 


.898 


8 


.059 


.002 


.834 



Regression Model for Predicting 
Math Posttest Score 



Standardized Increment 



B *I| ry « R *9 reS6ion xn r2 in "tolerance 
° rder * Coefficient Sequence 



1 


.564 


.445 




3 


-.051 


.004 


.875 


2 


-.147 


.023 


.830 


4 


.034 


.001 


.826 


7 


.048 


.001 


.435 


NA 








6 


-.077 


.002 


.703 


5 


.034 


.002 


.982 


NA 








NA 








NA 








NA 









Pretest Score 
White/Minority Status 
Free-Meals Participation 
Teacher's Judgment of CE Seed 
Mother's Educational Attainment m 
School's Minority Concentration 
School's CE Concentration 
School's Low-Achxcver Concentration 
Parent/Community Involvement 
District Control of Instruction 
Teachers ' Involvement in Decisions 
District's % "of Administrate Staff 
R ? (R) for the Regression Model 



2 " 
5 

NA 
10 
6 

NA 
7 
9 
8 



.653 


.636 




.048 


.004 


.776 


-.055 


.011 


.893 


-.151 


.018 


.680 


.048 


.002 


.823 


.027 


.001 


.726 


-.053 


.001 


582 


-.028 


.001 


.973 


-.029 


.6ol 


.981 


-.028 


.001 


.969 


.674(.821) 




.699 


.707 




-.003 


.003 


.857 


-.022 


.001 


.702 


-.108 


.010 


.610 


.054 


.004 


.875 


-.103 


.005 


.SlO 


-.028 


.001 


.962 


.037 


.002 


.986 



.637 
.05b 



.525 
.001 



2 


-.125 


.016 


.811 


3 


.054 


.004 


.926 


0 


.080 


.002 


.268 


NA 








7 


-.094 


.002 


.596 


6 


.053 


.002 


.861 


NA 








5 


-.051 


.002 


.993 


NA 










.553(.744) 




1 


.588 


.538 




3 


.010 


.007 


.877 


4 


- 006 


.003 


.775 


2 


-.135 


.027 


.750 


NA 








7 


.087 


.002 


.284 


5 


-.275 


.031 


.592 


8 


-.031 


.001 


.906 


NA 








9 


- 025 


.001 


.949 


6 


.052 


.00 3 


.975 




.612(.?82) 




1 


.683 


.593 




NA 








2 


-.046 


.008 


.915 


3 


-.068 


.004 


.734 


4 


.041 


.002 


.84 4 


7 


.069 


.002 


.474 


8 


-.036 


.002 


.876 


5 


-.102 


.004 


.756 


9 


-.030 


.001 


.799 


6 


-.032 


.002 


.987 



Pretest Score 
White/Minority btatus 
Free-Meals Participation 
T«acher's Judgment of CE Seed 
Mother's Educational Attainment 
School's Minority Concentration 
School's Low-Achiever Concentration 
Parent/Community Involvement 
Principal's Instructional Leadership 
District's Testing Program 
Distnrt's *. of Administrative Sta 
R*(R) for the Regression Model 



5 
2 
3 

NA 
S 6 
NA 
8 

NA 

7 



Pretest Score 
White/Minority Status 
Free-Meals Participation 
Teacher ' s Judgment of CE Need 
Mother's Educational Attainmont 
School's Minority Concentration 
School's CE Concentration 
School's Low-Achiever Concentration 
Parent/Community Involvement 
Principal's instructional Leadershi 
R J (R) for .the Regression Model 



1 


.816 


.76* 




4 


.063 


<.00l 


.886 


NA 








2 


-.076 


.005 


.644 


3 


.034 


.001 


.876 


5 


.054 


.001 


.444 



.777(.882) 


1 


.810 


.800 




NA 








2 


-.070 


.007 


.809 


3 


-.048 


.001 


.651 


4 


.020 


< .001 


.833 


HA 








7 


-.032 


.001 


.604 


6 


.027 


.001 


.962 


NA 








5 


-.028 


.001 


.935 




811 (.900) 




1 


.819 


.809 




4 


.039 


.001 


.860 


NA 








2 


-.075 


.004 


.663 


3 


.038 


.002 


.968 


6 


.0.8 


< .001 


.235 


NA 








5 


-.052 


<.001 


.543 


NA 








7 


.016 


<.001 


.970 




.8l7(.904) 





Pretest Score 
White/Minority Status 
Free-Meals Participation 
Teacher's Judgment of CE Need 
Mother's Educational Attainment 
School's Poverty Concentration 
School's Low-Achi#ver Concentration 
Parent/Community Involvement 
Teachers' Involvement in Decisions 
Disturbance of Instruction 

R ? (R) for the Regression Model 



1 


.717 


.655 




4 


.025 


.001 


.715 


2 


-.042 


.005 


.850 


3 


-.060 


.002 


.704 


6 


.022 


.001 


.853 


b 


)58 


.002 


.288 


5 


-.103 


.004 


.586 


9 


.042 


.001 


.906 


10 


-.031 


.001 


.921 


7 


-.054 


.002 


.864 



Protest Score 
White/Minority Status 
Free-Meals Participation 
Teacher's Judgment of CE Hoed 
Mother's Educational Attainment 
School's Minority Concentration 
School's Poverty Concentration 
School's Low-Achiever Concentration 
Disturbance of Instruction 
District's % of Administrative Staf 
r ? (r) for the Regression Model 



1 


.756 


.679 




5 


.040 


.001 


.742 


4 


-.042 


.001 


.833 


3 


-.074 


.004 


.733 


2 


.060 


.005 


.924 


NA 








6 


044 


.001 


.493 


NA 








7 


-.025 


.001 


.847 


NA 









Vh^u, describing student's background and characteristics of educational environment that wore employed as potential 

m, or, tro Xn in Table >-7. A criterion of 2.0 for the 'Partial F-to-enter' was used for the selection of the 
predictors are given in ™ f orvar d stepwise selection procedure, background variables (the first listed) 

Predi riv°en Tt&E priority of "en ry over the characteristics of educational environment, so that the background 
^Vrt cVJlrT adlSs ed n the assessment of the effect, of the characteristics of educational environment. The 
differences w ^ d ^"^ t l th ' n p roporfci on of variance of the predictor not explained by other predictors already entered 
t th n regression m£e" so valu« near 1.0 indicate lack of collinearity among the predictors. (HA - Hot Applicable.) 



ERIC 



Effect* of Character i»tic» of Educational Practice! on Student Achievement, Adjusted for Difference* in Student 
Background Characteristic* (Based on 15% Random Samples from Each Grade from the First-Year SES Data Base) 



Selected student Background 
Variables and Characteristics 
of Educational Practices 
' »for the Prediction of 
Achievement Posttest Score* 



Entry 
Order* 



Pretest Score 
Free-Meals Participation 
Teacher's Judgment of CE Need 
Mother's Educational Attainment 
Effort in Curriculum Development 
Effort in Planning and Evaluation 
Teacher,* s Use of Lesson Plans 
Frequency of Feedback per Semester 
weekly Homework Assigned 
Individualization of Instruction 
Monthly Use of Audio-Visual Equipment 
R*(R) for the Regression Model 



Pretest Score 
White/Minority status 
Free-Meals Participation 
Teacher *s Judgment of CE Need 
Mother's Educational Attainment 
Frequency of Feedback per Semester 
weekly Homework Assigned 
Monthly Use of Materials 
Monthly Use of Audio-Visual Equipment 
R*(R) for the Regression Model 



Pretest Score 
White/Minority Status 
Free-Meals Participation 
Teacher's Judgment of CE Need 
Mother's Educational Attainment 
Frequency of Feedback per Semester 
Weekly Homework Assigned 
Individualization of Instruction 
Monthly Use of Audio-Visual Equipment 
R J (R) for the Regression Model 



Regression Model for predicting 
Reading Posttest score 



Standardised Increment 



Regression 
Coefficient 



in R 2 in Tolerance 
Sequence 



1 


.531 


.438 




1 


.583 


.445 




4 


-.041 


.001 


.783 


3 


-.052 


.004 


.875 


2 


-.203 


.038 


.774 


2 


-.146 


.023 


.830 


3 


.068 


.005 


.871 


4 


.037 


.001 


.826 


NA 








10 


-.033 


.001 


.806 


HA 








9 


.048 


.001 


.930 


7 


.037 


.001 


.971 


6 


-.040 


.001 


.998 


NA 








7 


.029 


.001 


.974 


& 


.040 


.002 


.964 


5 


.049 


.002 


.974 


NA 








8 


-.037 


.001 


.960 


5 


.055 


.003 


.993 


NA 









.488 (.698) 



659 
.072 
.065 
.149 
.049 



.636 
.004 
.011 
.018 
.002 

<.001 



.025 .001 
.672 (820) 



.776 
.893 
.680 
.823 

.968 

%990 



.718 
.043 
.041 
.114 
.059 



.707 
.003 
.001 
.010 
.004 



.857 
.702 
.610 
.875 



.726 (.852) 



Regression Model for Predicting 
Math Posttest Score 



Standardized Increment 



• ^ression in R 
0rder Coefficient Sequence 



2 in Tolerance 



.480 (.693) 



.642 
.035 



.525 
.001 



2 


-.128 


.016 


.811 


3 


.063 


.004 


.926 


6 


.038 


.001 


.976 


7 


.027 


.001 


.913 


5 


.047 


.003 


.994 


NA 


.551 


.742) 




1 


.615 


.538 




3 


.049 


.007 


.877 


4 


-.060 


.003 


.775 


2 


-.165 


.027 


.750 


NA 








6 


.038 


.001 


.990 


7 


-.045 


.00? 


.961 


5 


-.051 


002 


.965 


8 


.029 
.580 


.001 
.761) 


.923 


1 


.698 


.593 




6 


.020 


.001 


.797 


2 


-.060 


.008 


.915 


3 


-.062 


.004 


.734 


4 


.050 


.002 


.844 


8 


.041 


.002 


.978 


5 


.060 


.004 


.996 


7 


-.042 


.001 


.944 



Pretest Score 
G White/Minority Status 
R Free-Meals Participation 
A Teacher's Judgment of CE Need 
D Mother's Educational Attainment 
E Frequency of Feedback per Semester 

Weekly Homework Assigned 
4 Individualization of Instruction 
R J (R) for the Regression Model 



1 


.810 


.769 




4 


.024 


<.001 


.886 


NA 








2 


-.079 


.005 


.644 


3 


.037 


.001 


.876 


NA 








NA 








NA 









.615 (.784) 



Pretest Score 
White /Minority Status 
Free-Meals Participation 
^Teacher's Judgment of CE Need 
Mother's Educational Attainment 
Effort in Curriculum Development 
Effort m Planning and Evaluation 
Teacher's Use of Lesson Plans 
Monthly Use of Materials 
Individualization of Instruction 
Monthly Use of Audio-Visual Equipment 
R*(R) for the Regression Model 



.079 
.039 
.022 



.025 
.021 
.028 ■ 



.800 

.007 
.001 
<.001 

.001 

.001 

<.001 
.001 



.809 
.651 
.833 



.908 
.897 
.930 



1 
4 

2 
3 
7 
6 

NA 
5 

NA 
NA 
NA 



.741 
.032 
.046 
.056 
.024 
.042 



.655 
.001 
.005 
.002 
.001 
.002 

.001 



.715 
.850 
.704 
.849 
.964 

.990 



.811 (.900) 



Pretest Score 

White/Minority Status 

Free-Meals Participation 
G Teacher's Judgment of CE Need 
R Mother's Educational Attainment 
A Effort in Curriculum Development 
D Effort m Planning and Evaluation 
B Teacher's Use of Lesson Plans 

Frequency of Feedback per Semester 
6 weekly Homework Assigned 

Individualization of Instruction 

Monthly Use of Audio-Visual Equipment 
R*(R) for the Regression Model 



1 


.828 


.809 




4 


.044 


.001 


.860 


NA 








2 


-.075 


.004 


.663 


3 


.040 


.002 


.868 


NA 








8 


.016 


<.001 


.959 


7 


.023 


.001 


.991 


6 


.024 


.001 


.981 


5 


.026 , 


.001 


.978 



.818 (.905) 



1 


.748 


.679 




5 


.033 


.001 


.742 


4 


-.033 


.001 


.833 


3 


-.075 


.004 


.733 


2 


.061 


.005 


.924 


11 


-.023 


<.001 


.907 


NA 








10 


-.024 


.001 


.987 


9 


.026 


.001 


.988 


7 


.034 


.001 


.974 


6 


.059 


.002 


.977 


8 


-.032 


.001 


.844 



.695 (.834) 



ribing student's background and characteristics of educational practices that were employed as potential 
given in Table F-7. A criterion of 2.0 for the 'partial F-tc-enter' was used for the selection of the 
el presented here. In the forward stepwise selection procedure, background variables (the first listed) 



Variables descri! 
predictors are < 

difference, -ere adjusted in the assessment of the effect, of the characteristics of educational «««e... The 
"clVAZ- col^n reports th. proportion of variance of the predictor not explained by «her predictors already ente , d 
into th. regression oodel. so values near 1.0 indicate lack of collinearity aaonq the predictors. <"A Not nppucaoie., 
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Tabl. F-U 



Effect, of Characteristic, of Clawroo* Organization on Student Achievement Adjusted for ^ ffe "" c "/ n ^ ent 
^"ground Characterise. (Ba.ed on 15* Random Sample, from Each Crade fro. the First-Year SES Data Base) 



Selected Student Background 
Variable, and Characteristic. 
o£ Classroom Organization 
for the Prediction of 
Achievement Post test Score* 



Grade 1 

Pretest Score 
Free-Meals Participation 
Teacher's Judgment of CE Need 
Mother's Educational Attainment 

R*(R) for the Regression Model 



Grade 2 

Pretest Score 
White/Minority Status 
Free-Meals Participation 
Teacher's Judgment of CE Need 
Mother's Educational Attainment 
Classroom Achievement Level 
Class Size 

R 2 (R) for the Regression Model 



Grade 3 

Pretest Score 
White/Minority Status 
Free-Meals Participation 
Teacher's Judgment of Ch Need 
Mother's Educational Attainment 
Classroom Achievement Level 
Class Size 

R 2 (R) for the Regression Model 



Grade 4 

Pretest Score 
white/Minority Status 
Free-Meals Participation 
Teacher's Judgment of CE Need 
Mother's Educational Attainment 
Extent of Ability Grouping 

R 2 (R> for the Regression Model 



Grade S 

Pretest Score 
White/Minority Status 
Free-Meals Participation 
Teacher's Judgment of CE Need 
Mother's Educational Attainment 
Classroom Achievement Level 

R 2 {r) for the Regression Model 



Grade 6 

Pretest Score 
White/Minority Status 
Free-Meals Participation 
Teacher's Judgment of CE Need 
Mother's Educational Attainment 

r 2 (r) for the Regression Model 



Regression Model for Predicting 
Reading Posttest Score 



Standardized 
^J 17 . Regression 
Order coefficient Sequence 



Increment 
in R 2 in 



.528 
.039 
.203 
.065 



.438 
.001 
.038 
.005 



.783 
.774 
.871 



.481 (.694) 



1 


.^60 


.636 




4 


.06$ 


.004 


.776 


3 


-.066 


.011 


.893 


2 


-.131 


018 


.680 


5 


.048 


.002 


.823 


NA 








NA 









1 


.718 


.707 




4 


. 343 


.003 


.857 


5 


-.041 


.001 


.702 


2 


-.114 


.010 


.610 


3 


.059 


.004 


.»75 


NA 








NA 









1 


.8:0 


.769 




4 


.0i4 


<.001 


.886 


NA 








2 


-.079 


.005 


.644 


3 


.037 


.001 


.876 


NA 









1 








NA 










-.084 


.007 


,809 


3 


-.045 


.001 


.oC! 


4 


.021 


<.O01 


.833 


S 


.026 


00 r 


.999 



8l/» (.900) 



1 1 


.b2C 


.SO* 




4 


.039 


001 


.860 


KA 








2 


-.075 


.004 


.60: 


3 


.043 


.^02 


.368 



Regression Model for Predicting 
Math Posttest Score 



Entry 
Order* 



Standardized Increment 
Regression m R in 
Coc f f i c ie nt Sequence 



NA 
2 
3 
5 

6 



.579 
.056 
.147 
.036 



.445 
.004 
.023 
.001 



.473 {.688) 



.647 
.030 

.*29 
.064 
.031 
.028 



.525 
.001 



.016 
.004 



1 


.616 


3 


.063 




-.062 


2 


-,167 


NA 




6 


-.029 


5 


-.035 



.5/6 <.759) 



.065 
.07 3 
051 
.041 



.5*: 

.008 
.004 
.002 
.002 



.609 (.780) 



.664 . SIM 



.690 (.8^1^ 



.875 
.830 
.826 



.811 

.926 



.001 


.998 


.001 


.974 


.740) 




.S38 




.007 


.877 


.003 


.7">5 


.027 


.750 


.001 


.995 


.001 


.*7"> 



.9;*> 
.734 

.844 
.998 



1 


.74V 






4 


.042 


001 


715 


2 


- 048 




.850 




-.055 


. 102 





751 


.€7 * 




Oil 


.001 


.'142 


029 


.001 


.833 


071 


.004 


.733 


o^: 




.924 



\^M„ de.criMn, ground an, J^"^."^!^*" ^"S 

pass sws^str ; h r= «^ r^^^' 

1 . u->.-r .,,«„*« ot ^ntrv over the characteristics of classroom organiza-ion, <o ^nac . 



ntcred 
caMe.) 



ERIC 



4 

420 



Table F-12 \ 

Pull-Model Regression of Feeding Posttest Score on Selected student Background and Education-Process 
Variables (Based on 15% Random Samples from Each Grade from the First-Year SES Data Base)* 



Selected Student Background 
Variables and Characteristics 
of Educational processes for 

" the Prediction of Reading 
Achievement posttest Score** 

Background Variables 
Pretest VSS Score 
White/Minority status 
Free-Meals Participation 
Teacher's Judgment of CE Need 
Mother's Educational Attainment 



Characteristics of instructional personnel 
Staff/Student Ratio 
Support /Teaching Personnel Ratio 
Years of Teaching 
Highest Degree Earned 
Recent Inservice Training 
Attitude to School Programs 



Characteristics of Educational Environment 
School's Minority Concentration 
School's CE Concentration 
School's Low-Achiever Concentration 
School's Central Resources 
Parent/Community Involvement 
District Control of Instruction 
Principal's Instructional Leadership 
disturbance of instruction 
District's Percent of Administrative Staff 



Characteristics of Educational Practices 
Efforts in Planning and Evaluation 
Teacher's Use of Lesson Plans 
Frequency of Feedback per Semester 1 
Meekly Homework Assigned 
Monthly Use of Materials 
Individualization of instruction 
Monthly Use of Audio-Visual Equipment 

Characteristics of Classroom Organization 
Classroom Achievement Level 



Standardized Regression Coefficient (Beta) 



Grade 1 

Entry „ fc 
Order: Beta 



Grade 2 



Entry 
Order 



Beta 



Grade 3 

Entry _ t 
Order Bet 



1 

NA 
4 

2 
3 



.523 

.063 
.219 
.071 



.651 
.051 
.054 
.153 
.050 



.697 


1 


.812 


1 


.809 


•J. 




.002 


4 


.063 


11 


.021 


4 


.029 


.028 


N 




2 


-.068 


NA 




.114 




-.074 


3 


-.043 


2 


-.079 


.052 


3 


.035 


4 


.024 


3 


.033 



NA 

NA 
5 

NA 
15 
NA 



.069 
.029 



NA 
NA 
7 

NA 
NA 



.041 



.033 



9 

NA 
11 
10 
NA 
NA 



.029 



.022 
.023 



NA 




NA 




NA 


7 


.071 


10 


.029 


NA 


NA 




6 


-.051 


6 


13 


.032 


NA 




NA 


8 


-.094 


NA 




NA 


14 


.029 


NA 




NA 


6 


.055 


NA 




8 


10 


.053 


NA 




NA 


NA 




9 


-.027 


7 


NA 




NA 




NA 


11 


.038 


NA 




NA 


NA 




NA 




NA 


12 


.034 


NA 




NA 


Na 




NA 




NA 


NA 




NA 




NA 


9 


.048 


11 


-.025 


NA 



-.101 



.024 
035 



R 2 (S) for the Regression Model 



Grade 4 



Grade 5 



Entry 
Order 



Beta 



Entry 
Order 



Beta 



NA 
NA 
6 

NA 
NA 
NA 



.033 



NA 

NA 
7 

NA 
NA 
NA 



.024 



5 

NA 
NA 
NA 
NA 
NA 
NA 
NA 
NA 



.053 



NA 
NA 
NA 
NA 
10 
NA 

NA 
5 

NA 



.030 

020 



.031 



Grade 6 



Entry 
Order 



Beta 



NA 
10 
NA 
NA 
5 

NA 



.018 



.033 



NA 

NA 
7 

NA 
NA 
NA 
NA 
NA 



-.040 



NA 



• ■ ■ m I ■ 111 ii^ iwm ^ 

!^v«! n ?K f r ° CeS ? v " iables i™olvec* in the present analyses as potential predictors include those already selected in the sub- 
• SucationaJ LlcS-l a ^° C ? SS variables " characteristics of instructional personnel, educational environment, 

^educational practices, and classroom organization. The results of these sub-analyses are summarized in Tables F-8 to f-11 by grades. 

r Q tepvise regression strategy employed in the sub-analyses was adopted here for the full-model analyses. In parficu'lar , 
'ER^C variables were given priorities of entry over the e ducat ion -pro cess variables. (NA - Not Applicable.) 



lsble F-13 

Full-Moo*: Regression of Math Postteit Score on Selected Student Background and Education-Process 
Variables <f*sed on 15% Random Samples fro=» Each Grade from the First-Year SES Data Base) 



Selected Student 3*ckg round 
Variables and Character *2tvcs 
of Educational Processes for 

Ui* Prediction of Math 
Achievement Wettest Score** 



Background Variables 
Pretest VSS Score 
White/Minczity Status 
Free-Meals Participation 
Teacher's Judgment ot CE Need 
Mother's Educational Attainment 



Characteristics of Instructional Personnel 
Support/Teaching Personnel Ratio 
Years of Teaching 
Recent Inservice Training 
Belief in Schooling 
Attitua* to School Programs 



Grade 1 



fc..fv 
Order 



Characteristics of Ideational Enviro.tment 
School's Minority Concent-ration 
School's Poverty Concentration 
School's CE Concentration 
School's Low Acn>ver Concentration 
School's Central Resources 
Parent /Community Involvec-nt 
Principal's Instructional Leadership 
Teacher's Involvement in Decision* 
Disturbance ot Instruction 
District's Testing Program 
District's Percent of Administrative Staff 



Characteristics of Educational Practices 
Effort in Curriculum Development 
Teacher's Use of Lesson Plans 
Frequency of Feedback pet Semester 
Weekly Homework Assigned 
Monthly Use of Materials 
Individualization of Instruction 
Monthly UC? of Audio-Visual Equipment 



ChaiScteris*-ics of Classroom Organization 
Extent of Ability Grouping 
Class Size 



h' 



?■ (R) for the Regression Model 



NA 

7 

5 

NA 
NA 
NA 



.046 



NA 
NA 



Standardized Regression Coefficient (Beta) 



Grade 2 



Entry 
Otd*»r 



Beta 



.485(.696) 



NA 
NA 

11 

6 

NA 
NA 



035 
C4 



NA 
12 



-.03C 



Grade 3 



Entry 
Order 



1 


.570 


1 


.629 


i 


.585 


NA 




4 


.052 


3 


.033 


3 


-.041 


NA 




4 


-.011 


2 


-.145 


2 


-.139 


2 


-.142 


4 


.036 


3 


.053 


NA 





Grade 4 



Grade 5 



Entry 
Order 



Beta 



Entry 
Order 



Beta 



Grade 6 

Entry « ^ 
Bet 

Order 



NA 




NA 




NA 


10 


.033 


5 




NA 


li 


.032 


NA 




10 


8 


.C4? 


NA 




NA 


NA 




NA 




NA 


NA 




10 


.066 


7 


NA 




NA 




NA 


HA 




NA 




NA 


6 


-.063 


9 


-.080 


5 


2 


.044 


NA 






NA 




i 


.056 


NA 


NA 




NA 




NA 


NA 




b 


-.042 


NA 


NA 




NA 




NA 


NA 




NA 




11 


NA 




NA 




6 



-.034 



-.031 



NA 
NA 
12 
NA 
NA 



.055 
036 



NA 
13 



,029 



.S6S(.7S2) 



.o!7(.736) 



.677 
.030 
- 042 
-.060 
.042 



.720 
.016 
-.040 
-.058 
.027 



.749 
.049 
-.039 
-.080 
.058 



NA 

8 .045 
34 .030 
NA 
NA 



12 
11 
NA 
NA 
14 



.028 
.030 



.029 



10 

9 

NA 

7 

NA 



-.036 
.050 



-.053 



11 


.074 


NA 




NA 


NA 




8 


.050 


11 


10 


-.043 


NA 




NA 


7 


-.088 


5 


-.089 


NA 


NA 




NA 




NA 


NA 




10 


.045 


NA 


12 


-.032 


NA 




NA 


NA 




15 


-.026 


NA 


n: 




7 


-.048 


NA 


NA 




NA 




NA 


NA 




NA 




NA 



NA 




9 


NA 




13 


13 


.034 


NA 


5 


.059 


NA 


NA 




NA 


15 


-.027 


MA 


NA 




NA 



-.037 
.025 



14 

NA 
13 

8 

NA 
6 

12 



.021 



.026 
.042 



.058 
-.026 



NA 
NA 



NA 
NA 



.t>26(.791> 



.677 (.823) 



.700 (.837) 



ERJC"^ step-is. -px-y- i" the S u,-^» : y»» rI ^ : a ^ f or ^^n-^i r^&u^V'T' 

BIBHBjent background variables were gi«n priority, of entry over the eduestion -process variants, m "tv 



ml 



\ 



Table F-14 

Correlations of Student-Background Variables and Education-Process Variables with Posttest Student 



Affect Scores (Based on 15% Random Samples front 


Each Grade 


from the 


First- 


Year SES 


Data Base)* 




Oa^A^IUUiiQ Vai lcLDIGS 


A 

ra e 


2 


3 


4 


5 


6 
















Educational Processes** 


N - 


1,197 


1,164 


1, 104 


1,217 


1,330 


Background Variables 














Pretest Student Affect Score 




.47 


.50 


.54 


.59 


.63 


White/Minority Status 




7. 16 


-.20 


-.16 


-.21 


-.23 


Free-Meals Participation 




.13 


.io 


.18 


.14 


.13 


Teacher's Judgment of CE Need (Reading and/or Math) 




.02 


.07 


.06 


.08 


.04 


Mother's Educational Attainment 




-.09 


-.07 


-.05 


-.06 


-.05 


Characteristics of Instructional* Personnel 


















.02 


.04 


.03 


.02 


-.02 


Support/Teach ing Personnel Ratio 




-.°0 


.04 


.06 


-.00 


-.04 


Years of Teaching (Reading Teacher) 




.04 


-.03 


.02 


.05 


.04 






.07 


-.00 


-.04 


.00 


-.04 


Highest Degree Earned (Reading Teacher) 




-.02 


-.02 


-.00 


.06 


-.04 


Highest Degree Earned (Math Teacher) 




-.02 


-.02 


.01 


.06 


-.01 


Recent Znservice Training (Reading Teacher) 




.04 


.05 


.08 


.04 


.07 


Recent Inservice Training (Math Teacher) 




.06 


.05 


.01 


.03 


.10 


Belief in Schooling (Reading Teacher) 




-.01 


.05 


.05 


.03 


-.01 


Belief in Schooling (Math Teacher) 




.01 


.05 


.03 


.05 


.04 


Attitude to School Programs (Reading Teacher) 




-.01 


--07 


-.04 


-.01 


.04 


Attitude to School Programs (Math Teacher) 




-.01 


-.07 


-.10 


-.04 % 


.02 


Characteristics of Educational Environment 














bCnOOJ. *> ninor ity concentration 




. 16 


.21 


.18 


.22 


.21 


School's Poverty Concentration 




.14 


.22 


.20 


.23 


.20 


School's Reading CE Concentration 




.06 


.08 


.02 


.09 


.14 


CjnVists-kl * « Mnt-Vi rP C r\ r> t~ c* r> t- r* n t- i r\ r> 

scnooi *> rvttn ve« vuiitciiLiatiuii 




.02 


.09 


-.00 


.11 


.15 


School's Reading Low— Achiever Concentration 




.16 


.22 


.17 


.20 


.19 


C/>Vi«ssn1 * « Mj»tVi Iau« Vi i auai* ronton t" y*j» t" i on 




.15 


.21 


.18 


.19 


.17 






-.01 


.02 


-.04 


-.01 


-.01 






.05 


.07 


.04 


.06 


.02 


Student Mobility Rate 




-.01 


.04 


.08 


.10 


.11 


Parent/Community Involvement 




.03 


.06 


.00 


.10 


.11 


District Control of Instruction 




.02 


-.01 


.00 


.07 


. 04 


Principal's Instructional Leadership 




.02 


-.02 


.01 


.01 


.04 


Teacher's Involvement in Decisions 




-.06 


-.06 


-.04 


-.08 


.02 


Disturbance of Instruction 




.04 


.09 


.11 


.04 


.07 


District's Testing Program 




.04 


-.00 


-.01 


.02 


-.01 


District's Percent of Administrative Staff 




.04 


.03 


.06 


.03 


.06 


Chj*T*j*r tf>y i *it i r q of P^iir^Moui I Practices 


















.03 


.06 


.05 


.08 


.07 


Effort in Curriculum Development (Math Teacher) 




-.01 


.07 


.03 


.00 


.04 


pffrwt- in Pi Anninn Anrt Fv* 1 imfr ion fR*»adinn Teacher 1 




.01 


-.02 


.06 


.02 


.04 


Fffo-rf in Plftnninn xrv) FvaluAfcion (Math T<*aeh<*f) 




.02 


-.03 


.02 


.06 


.05 


pAJiHfnn Ta»^ hoy'c IIca of Ii>fiC/>n Plane 




-.04 


.03 


-.02 


-.02 


-.03 


Tck mr*ht£% v* * o Iter* /"\ ^ f ACCAn PI AnC 

nain ieacner s use 01 Lcabon rxaiia 




.01 


.02 


-.01 


.01 


-.04 


Reading Teacher's Frequency of Feedback per Semester 




-.06 


.03 


.03 


.08 


.02 


piacn icacncxT s rxrc^uciiwy ui tccuua^A pci ocinc3i>ui 




-.05 


.05 


-.01 


.09 


.00 


Weekly Reading Homework Assigned 




.10 


.09 


-.00 


-.01 


.11 


Weekly Math Homework Assigned 




.14 


.10 


.02 


.02 


.00 


Monthly Use of Reading Materials 




.02 


.01 


-.05 


.06 


.04 


Monthly Use of Math Materials 




.02 


.05 


.01 


.04 


.04 


Individualization of Reading Instruction 




.04 


.02 


.01 


.07 


.13 


Individualization of Math Instruction 




-.04 


-.01 


.05 


.07 


.10 


Monthly Use of Audio-Visual Equipment in Reading 




.02 


.05 


.02 


.12 


.08 


Monthly Use of Audio-Visual Equipment in Math 




.02 


.< j 


.00 


.01 


.06 



*The Student Affective Measure (SAM) was not administered to the first graders in the fall so that the 
analyses in this section were not performed for grade one. 
**Some variables have been aggregated to classroom (Teacher) or school levels. The following categorical 
variables have been specially coded for the present, analyses: Teacher's Judgment of CE Need (0 * 
no need of CE in both reading and math, 1 * Need CE in reading and/or math); School's Central Resources 
(0T * no resource center in subject area* 1 « presence of resource center in subject area); Teacher's 
Use of Lesson Plans (0 * lesson plans in subject area are not used; 1 * lesson plans in subject area 
are used) . 
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Table F-15 

Effects of Characteristics of Instructional Personnel on Student Affect, 
Adjusted for Differences in Student Background Characteristics 
(Based on 15% Random Samples from Each Grade from The First-Year SES Data Base) 



Selected Student Background 
Variables and Characteristics 
of Instructional Personnel 
for the Prediction of 
Posttest Student Affect Score* 



Entry 
Order 



Standardized 
Regression 
Coefficient 



Increment 
in R 2 in 
Sequence 



Tolerance 



Grade 2 

Pretest Student Affect Score 
White/Minority Status 
Mother's Educational Attainment 
Years of Teaching (Math Teacher) 
Years of Teaching (Reading Teacher) 
R 2 (R) for the Regression Model 



Grade 3 

Pretest Student Affect Score * 
Free-Meals Participation 
White/Minority Status 

Attitude to School Programs (Math Teacher) 
Highest Degree Earned (Reading Teacher) 
R 2 (R) for the Regression Model 



Grade 4 

Pretest Student Affect Score 
Free-Meals Participation 
White /Minority Status 

Recent Inservice Training (Reading Teacher) 
Attitude to School Programs (Math Teacher) 
Attitude to School Programs (Reading Teacher) 



R 2 (R) for the Regression Model 



1 


.452 


.223 




2 


-.085 


.007 


.975 


3 


-.045 


.002 


.967 


4 


.131 


.004 


• 982 


5 


-.079 


.001 






.236 


(.486) 




1 


.474 


.249 




2 


.108 


.016 


.978 


3 


-.048 


.002 


.705 


4 


-.044 


.002 


.983 


5 


-.043 


.002 


.987 




.272 


(.521) 




1 


.515 


.287 


\ 


2 


.081 


.010 


.979 \ 


3 


-.021 


.002 


.831 


4 


.049 


.003 


.951 


5 


-.091 


.002 


.933 


6 


.054 


.001 


.441 




.305 


(.552) 





Grade 5 

Pretest Student Affect Score 
White/Minority Status 
Free-Meals Participation 
Highest Degree Earned (Math Teacher) 
Years of Teaching (Reading Teacher) 
R 2 (R) for the Regression Model 

Grade 6 

Pretest Student Affect Score 
White/Minority Status 

Attitude to School Programs (Reading Teacher) 
Years of Teaching (Math Teacher) 
Staff/Student **atio 
Years of Teaching (Reading Teacher) 
Recent Inservice Training (Math Teacher) 
Recent Inservice Training (Reading Teacher) 



R 2 (R) 



for the Regression Model 



1 


.574 


.352 




2 


-.050 


.006 


.944 


3 


.050 


.002, 


.745 


4 


.051 


.003 


.995 


5 


.039 


.002 


.997 




.363 


(.603) 




1 


.607 


. 398 / 




2 


* -.106 


.007 


.947 


3 


.0£1 


.005 


.956 


4 


-.072 


.003 


.971 


5 


-.042 


.002 


.997 


6 


.039 


.001 


.710 


7 


.053 


.001 


.972 


8 


-.039 


.001 


.636 




.418 


(.647) 





Variables describing stuaent s uaw^iuum o..^ — — . 

that were employgk as potential predictors are given in Table F-14. A criterion of 2.0 for 
Se -Portia! F^EnteV- was used for the selection of the prediction model presented here. 
S thfforward stepwise selection procedure, background variables (the first listed were 
given a higher priority of entry over the characteristics of instructional personnel, so 
that the backgrou* differences were adjusted in the assessment of the effects of the 
ciaracteristicslT instructional personnel. The -Tolerance" column reports the proportion 
of variance of the predictor not explained by o ,her predictors already entered into the 
regression model, do values near 1.0 indicate lack of collinearity among the predictors. 



Table F-16 

Effects of Characteristics of Educational Environment on Student Affect, 
Adjusted for Differences in Student Background Characteristics 
(Based on 15% Random Samples from Each Grade from the First-Year SES Data Base) 



Selected Student Background 
Variables and Characteristics 

of Educational Environment 
for the Prediction of 
Posttest Student Affect Score* 



Entry 
Order 



Standardized 
Regression 
Coefficient 



Increment 
in R 2 in 
Sequence 



Tolerance 



; Grade 2 

Pretest Student Affect Score 
White/Minority Status 
Mother's Educational Attainment 
School's Reading Low-Achiever Concentration 
School Js Math CE Concentration 
r2(R) for the Regression Model 



1 


.454 


.223 




2 


-.039 


.007 


.975 


3 


-.032 


.002 


.967 


4 


.100 


.005 


.670 


5 


-.051 


.002 


.843 




.238 


(.488) 




1 


* .471 


.249 




2 


.082 


.016 


.978 


3 


-.001 


.002 


.785 


4 


.108 


.OOC 


.587 


5 


-.085 


.005 


.999 


6 


.065 


.004 o 


.926 




.282 


(.531) 





Grade 3 

Pretest Student Affect Score 
Free-Meals Participation 
White /Minority Status 

School's Reading Low-Achiever Concentration 
•teacher's Involvement in Decisions 
School's Reading Central Resources 
v R 2 (R) for the Regression Model 



Grade 4 

Pretest Student Affect Score 
Free-Meals Participation 

White /Minority Status 
School's Minority Concentration 
District's Percent of Administrative Staff 
School's Math Central Resources „ 
School's Reading Central Resources 
Disturbance of Instruction 
Principal's Instructional Leadership 
School's Math CE Concentration 
R 2 (R) for the Regression Model 



1 


.512 


.287 




2 


.074 


.010 


.979 


3 


.008 


.002 


.831 


4 


.079 


.003 


.442 


5 


.051 


.003 


.985 


6 


.102 


.002 


.953 


7 


-.066 


.004 


.744 


8 ■ 


.062 


1 .002 


.947 


9 


-.047 


' .002 


.843 


10 


-.046 


.002 


.878 



.317 (.563) 



Grade 5 

Pretest Student Affect Score 

White /Minority Status 

Free-Meals Participation 

School's Poverty Concentration 

District's Percent of Administrative Staff 

Teacher's Involvement in Decisions 

Disturbance of Instruction 

Student Mobility Rate 

R 2 (R) for the Regression Model 



1 


.564 


.352 




2 


-.026 


.006 


.944 


3 


.005 


.002 


.745 


4 


.098 


.005 


.532 


5 


.043 


.002 


.993 


6 


-.044 


.002 


.980 


7 


-.044 


.001 


.863 


8 


.039 


.001 


.878 




.370 


.609) 




1 


.606 


.398 




2 


-.074 


.007 


.947 


3 


.050 


.003 


.911 


4 


.032 


.001 


.992 




.409 


(.639) 





Grade 6 

Pretest Student Affect Score 
White/Minority Status 
School's Math CE Concentration 
District's Percent of Administrative Staff 
R 2 (R) for the Regression Model 



•Variables describing student's background and characteristics of educational environment 
that were employed as potential predictors are given in Table F-14. A criterion of 2.0 for 
the "partial F-to-Enter' was used for the selection of the prediction model presented here. 
In the forward stepwise selection procedure, background variables (the first listed) were 
given a higher priority of entry over the characteristics of educational environment, so 
that the background differences were adjusted in the assessment of the effects of «• 
characteristics of educational environment. The 'Tolerance' column reports the proportion 
of variance of the predictor not explained by other predictors already entered into the 
regression model, so values near 1.0 indicate lack of collinearity among the predictors. 
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Table F-17 



Effects on Characteristics of Educational Practices on Student Affect, 
Adjusted for Difference? in Student Background Characteristics 
(Ba^ed on 15% Random Samples from Each Grade from the First-Year SES Data Base) 



Selected Student Background 
Variables and Characteristics 
of Educational Practices 
for the Prediction of 
Posttest Student Affect Score* 



Entry 
Order 



StandardizeSWncrement ' 
in R 2 in Tolerance 
Sequence 



Regression 
Coefficient 



Grande 2 






.223 




Pretest Student Affect Score 


1 


.452 




White/Minority Status 


2 


-.054 


.007 


.975 


Mother's Educational Attainment. 


3 i* 


7.044 


.002 


.967 


Weekly Math Homework Assigned 


4 


.071 


.005 


.911 


Reading Teacher's Frequency of Feedback per Semester 


5 


-.C51 


.003 


.989 - 


. R 2 (R) for the Regression Model 




.239 


(.489) 




Grade 3 






.249 




Pretest Student Affect Score 


1 


.470 




Free-Meals Participation 


2 


.110 


.016 


.978 


White/Minority Status 


3 


-.055 -» 


,002 


.785 


Reading Teacher's Use of Lesson Plans 


4 


.067 


.004 


.970 


Weekly Reading Homework Assigned 


5 


.058 


.004 


.980 


Math Teacher's Frequency of Feedback per Semester 


6 


: .043 


.002 


.989 


R 2 (R) for the Regression Model 




, .277 


(.527) J 




Grade 4 






.287 




Pretest Student Affect Score 


1 


.516 


.979 


Free-Meals Participation 


2 


.086 


.010 


White/Minority Status 


3 


-.041. 


.002 


.831 


Effort in .Planning and Evaluation (Prading Teacher) 


4 


.055 


.003 


.998 


R 2 (R) for the Regression Model 




.301 


(.549) 





Grade 5 

Pretest Student Affect Score 
White/Minority Status 
Free-Meals Participation 

Math Teacher's Frequency of Feedback per Semester 
Weekly Reading Homework Assigned 
R 2 (R) for the Regression Model 



Grade 6 

Pretest Student Affect Score 
White/Minority Status 

Individualization of Reading Instruction 
Individualization of Math Instruction 
Effort in Curriculum Development (Reading Teacher) 
R 2 (R) for the Regression Model 



1 


.572 


.352 




2 


-.059 


.006 


.944 


3 


.046 


.002 


.745 


4 


.067 


.004 


.999 


5 


-.037 


.001 


.975 




.365 


(.604) 




1 


.607 


.398 




2 


-.074 J 


.007 


.947 


3 


.042 


.004 


,.966 


4 


.039 


.002 


.885 


5 


.033 


.001 


.355 




,411 


(.641) 





•variaoies aescriDing student s oa^yruimu ana un«a^i.cii3wi.a ~- — r 

that were employed as potential predictors are given in Table F-14 . A criterion of 2.0 for 
the 'partial F-to-Enter' was used for the selection of the prediction model presented here. 
In £he forward stepwise selection procedure, background variables (the first listed) were 
given a higher priority of entry over the characteristics of educational practices, so 
that the background differences were adjusted in the assessment of the effects of the 
characteristics of educational practices. The 'Tolerance' column reports the proportion 
of variance of the predictor not explained by other predictors already entered into the 
regression model, so values near 1.0 indicate lack of collinearity among the predictors. 
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Table G-l 

Estimated Standard Deviations for Z-Score Gains 

Reading Matn 



RTT* ZSD* RTT 



1 




.59 


.906 


. 62 


. O / Z 


2 




.76 


.693 


.67 


.812 


3 




.81 


.616 


.71 


.762 


4 




.81 


.616 


.73 


.735 


5 




.88 


.490 


.77 


.678 


6 




.89 


,469 


,80 


.632 


* 

RTT = 


Average 


test-retest (fall to spring) 


correlation (from 






Table 1- 


15 of Report 9) 








ZSD = 


Standard 


Deviation of z- 


score gain ( 


= /2(1-RTT) ) . 
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Table C-2 

Percentage of Students Whose Pall-to-Spring Growth I* At Least One Standard Deviation Above or 
Below the Average of Their Peers with Comparable Pall Achievement Status, by CE Category* 



Categories of 
fall -to- Spring 
Growth* 



CE Selection Category 



Title I 
Students 
In Title I 
Schools 



Other -CE 
Students 
in Title X 
Schools 



CE 

Students 
in Other-CE 
School 



N 






% 


N 


% 


N % 


">02 


"».3 


70 


7.1 


38 






778 


10.9 


2 ,228 








4 38 


76. "> 


5 


664 


79. 3 






129 


131 


98 


17.1 




698 


9.8 


2 " 


100.1 


987 


100*0 


574 


100.0 


7 


140 


100.0 


271 


8.9 


72 


7.6 


84 


11 .9 




522 


8 . 7 


2,420 








555 


78.8 


4,865 


80.7 


345 






13*2 


65 


9.2 




640 


10.6 


3.036 


1000 


948 


100 "o 


704 


99.9 


6 


027 


100.0 


264 


8 7 


78 


8.8 


68 


10.8 




536 


9.0 


2,476 


81.9 


693 


78.4 


499 


79.3 


4 


929 


82 5 


282 


9.) 


113 


12.8 


6. 


9.9 




512 


8.6 


3,022 


99 9 


884 


100.0 


629 


106.0 


5 


,977 


100.1 


200 


8.4 


61 


7.1 


58 


9.4 




450 


7.0 


1,881 


78.6 


703 


81.4 


484 


78 2 


5 


,522 


85.6 


311 


13.0 


100 


11.6 


77 


12.4 




480 


7.4 


2,392 


100.0 


864 


100.1 


619 


100.0 


6 


,452 


100.0 


181 


8 1 


51 


6.4 


66 


11.2 




599 


8.8 


1.752 


78.7 


649 


80.9 


443 


75.5 


5 


.517 


81.0 


294 ' 


13.2 


102 


12.7 


78 


13.3 




694 


10.2 


1,227 


100 0 


802 


100.0 


S87, 


100.0 


6 


,810 


100.0 


235 


11.9 


99 


10.9 


40 


6 5 




697 


10.1 


1,500 


75.7 


705 


77 9 


484 


78.1 


5 


,468 


79.4 


247 


12.5 


101 


11.2 


96 


15.5 




,726 


10.5 


1,982 


100.1 


905 


100.0 


620 


100.1 


6 


,891 


100.0 



Non-CE 
Students 
in Title 1 
Schools 



Non-CE 
Students 
in Other-CE 
Schools 



Students 
in Non-CE 
Schools 



Reading Achievement* 

High 
Average 
Low 
Total 

High 

Aserage 

low 

Total 

High 

Average 

tow 

Total 

High 
Average 
bow 
Total 

Average 

low 

Total 

High 
Average 
Low 
Total 



291 
2,582 

365 
3,238 

256 
2,322 

264 
2,842 

296 
2,383 

248 
2,927 

247 
2,645 

280 
3.172 

383 
2,865 
.355 
3,603 

582 
4.494 

729 
5.805 



9.0 
79.7 
11.3 
100.0 

9 0 
81.7 

9.3 

100 0 

10.1 
81.4 
8.5 
100.0 

7.8 
83.4 
8.8 
100.0 

10 6 
79.5 

9 9 
100.0 

10.0 
77.4 



220 
1,717 

214 
2,151 

158 
1.549 

247 
1.954 

189 
1.563 

186 
1,938 

171 
1 19 

165 
1.955 

210 
1.781 

214 
2.205 

249 
1.987 

2l9 
2.515 



10.2 
79.8 
10.0 
100.0 

8.1 f 
79.3* 
12.6 

100.0 

9.8 
80.7 
9.6 
100.1 

8.8 
82 8 
8.4 
100.0 

9.5 
80.8 
9.7 
100.0 

9.9 
79.0 
11.1 

100.0 



1,599 
13,4X7 

1,859 
16,875 

1.363 
12,462 

1.686 
15.511 

1,431 
12.543 

1,403 
15.377 

1.187 
12.854 



9.5 
79.5 
11.0 
100.0 

8.8 
80.3 
10.9 
100.0' 

9.3 
81.6 



7.7 
83.2 



15,454 100.0 

1,490 9.2 
13.007 

1.737 
16.234 



1.902 
14.638 

2.178 
18,718 



80.1 
10.7 
100.0 

10.2 
78.2 
11. f 

100.0 




I . .. 



with coeparable fall achieveaent status High 
Low - *t least one s d below the average 

CM-Square statistics show signitxcant associations between CE status and growth category at the 



01' level in 411 cases. 
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Table G-3 



Means of the Potential Discriminating variables Employed m the Discriminant Analysis for the 
Two Groups of Students Whose Fall-to-Spring Achievement Growth in Reading is One Standard Deviation 
Above CHigh' Growth) or Below CI^oW Growth) the Average of Their Peers with Comparable Fall Achievement 



Potential 
Discriminating 
variables 




Student Characteristics 

Pretest Achievement Quartile 
Participation in Compensatory Education 

Instructional Services Received Per Year 
Regular Instruction 
Special Instruction 
Tutor/Independent Work 

Characteristics of Educational Process 
Staff /Student Ratio 
Support /Teaching Personnel Ratio 
Years of Teaching 
Highest Degree Earned 
Recent Inservice Training 
Attitude to School Programs 
School's Minority Concentration 
^School's CE Concentration 
School's Low-Achiever Concentration 
School's Central Resources 
Parent /Community Involvement 
District Control of Instruction 
Principal's Instructional Leadership 
Disturbance of Instruction 
District's Percent of Administrative Staff 
Effort in Planning and Evaluation 
Teacher's Use of Lesson Plans 
Frequency of Feedback per Semester 
Weekly Homework Assigned 
Monthly Use of Materials 
Individualization of Instruction 
Monthly Use of Audio -Visual Equipment 
Classroom Achievement Level 



Means for the 'High' and 'Low' Achievement Growth Groups 



Grade 3 



f2. 16* 
.19* 

148.49* 
50.96* 
111.03* 

.06* 

.13* 
11.85* 

2.40 
13.28* 
11.71* 
36.42* 
24.39 
38.01 

.67* 
45.46 
41.68 
54.44 
52.55 
4.80 
23.52 

.96 
125.27 

.62* 
81.24* 
20.04 
24. *M 

.66 



Means for the two groups differ significantly at the .01 level. 



2. 


84* 


2. 


10* 


2. 


73* 


2.09* 


2.71* 


2. 


11* 


2. 


32* 




30* 




28 




30 




28 




31 




28* 




35* 


124 . 


07* 


128 . 


29 


120. 


00 


105. 


03 


104. 


26 


99. 


78 


94. 


37 


65 . 


43* 


55 . 


73* 


62. 


67* 


50.64 


55. 


36 


39. 


92* 


48. 


17* 


103 . 


21* 


103 . 


42 


100. 


53 


93.66* 


87. 


06* 


72. 


55 


71. 


67 




07* 




07* 




07* 




07 




07 




07 




07 




14* 




14* 




16* 




14 




14 




16 




15 


10 


30* 


12 


87* 


10 


82* 


12 


11* 


11 


15* 


12 


20 


11 


66 


2 


41 


2 


51 


2 


47 


2 


51 


2 


49 


2 


55 


2 


54 


11 


29* 


11 


56 


13 


12 


11 


18 


10 


85 


12 


40 


11 


28 


11 


42* 


11 


23 


11 


10 


11 


10 


11 


29 


10 


74 


10 


88 


32 


96* 


31 


31* 


43 


56* 


34 


78 


36 


54 


40.08 


37 


34 


22 


.91 


23 


59 


24 


99 


24 


31 


25 


68 


25 


06 


26 


79 


37 


68 


37 


45* 


42 


22* 


38 


83 


39 


98 


40 


26 


39 


80 




.61* 




65 




66 




71 




69 




.66 




66 


45 


.20 


46 


37 


45 


98 


45 


.24 


45 


84 


45 


.22 


45 


00 


41 


.61 


41 


31 


41 


79 


41 


.28 


41 


5S 


41 


.35 


41 


.53 


53 


.85 


53 


.78 


54 


.17 


53 


.48 


54 


15 


53 


.34 


53 


.60 


51 


47 


51 


.74* 


53 


.79* 


51 


.02 


52 


39 


51 


.37 


52 


.98 


4 


.85 


4 


.80* 


5 


.06* 


4 


.90 


4 


.70 


4 


.74 


4 


.97 


22 


.89 


23 


.67 


23.26 


23 


.06* 


21 


.81* 


22 


.69 


22 


.47 




.97 




■ 92 




.94 




.93 




.9? 




.95 




.93 


125 


.82 


129 


.80* 


121 


.52* 


122 


.35 


116 


.87 


107 


.89 


101 


.28 




.50* 




.67 




.60 




.62 




.57 




.71* 




.78 


75 


.45* 


78 


.91 


77 


.36 


71 


.94 


70 


.53 


64 


.91 


64 


.68 


19 


.97 


20 


.15 


19 


.99 


20.66 


20 


.54 


20 


.50 


20 


.71 


23 


.16 


22 


.50 


23 


.17 


22 


.08 


20 


.87 


20 


.32 


20 


.53 


.61 




.53 




.52 




.53 




.50 




.46 




.47 




Grade 4 



Grade 5 



High 
1,024 



Low 
1,212 



High 



High 



45 



1,293 


1,498 . 


1,611 


1 ,770 


2 . 


26* 


2. 


39* 


2. 


37* 


2.56* 




19* 




26* 




19 


.19 


101. 


16* 


90. 


27* 


96 


77 


91 . 84 


30. 


55* 


37. 


01* 


29 


09 


29 .09 


66 


34 


68. 


52 


61 


85 


59 .47 




07 * 




07* 




07 


.07 




17* 




15* 




19* 


.21* 


11 


98 


11 


27 


11 


28* 


10.24* 


2 


52 


2 


53 


2 


53 


2.56 


9 


70 


10.90 


11 


83* 


9.40* 


11 


05 


10 


77 


10 


57 


10.50 


30 


50* 




5(f* 


34 


.27 


32.67 


19 


41* 


22 


47* 


20.25* 


18.06* 


35 


96* 


40 


47* 


37 


.67 


37.38 




61 




60 




.60* 


.53* 


43 


.51 


43 


.94 


42 


.79* 


41.25* 


41 


!36 


41 


.45 


41 


.65 


41.77 


53 


.63 


53 


.42 


53 


.28 


53.05 


50 


.98* 


*4 


.36* 


54 


.03 


55.34 


4 


.80* 


5 


.15* 


4 


.96 


5.09 


21 


.99 


21 


.71 


21 


.46* 


20.46* 




.96 




.95 




.96* 


.94* 


96 


.83 


90 


.99 


83 


.20 


78.38 




.84 




.79 




.87 


.82 


62 


.18 


62 


.98 


59 


.04 


57.27 


19 


.79* 


20 


.34* 


20.18 


19.95 


16 


.49 


17.81 


16.25 


15.17 




.40 




.44 




.40 


.42 



Table C-4 

Means of the Potential Discriminating variables Employed in the Discriminant Analysis for the 
Two Groups of Students Whos i Fall-to-Spring Achie- *ment Growth in Math is One Standard Deviation 
Above ('High' Growth) or Below ('Low* Growth) the Average of Their Peers with Comparable Fall Achievement 



Potential 
Discriminating 
Variables 



Means for the 'High' and 'Low' Achivement Growth Croups 



Grade 1 



Grade 2 



Grade 3 



High 



High 



High 



N ■ 


1 , 


639 


1 1 


572 


1, 


328 


1 , 


432 


1, 


192 


1, 


385 


1, 


301 


1, 


423 


1, 


347 


1, 


337 


1, 


570 


2,003 


Student Characteristics 


















































Pretest Achievement Quart ile 


2 


. 05* 


2 


.78* 


2 


.02* 


2 


.76* 


1 


.98* 


2 


.86* 


2 


.04* 




.80* 


2 


.16* 


2 


.67* 


2 


.21* 


2 


.77' 


Participation in Compensatory Education 




. 17 




.16 




. 15* 




.19* 




.18 




.20 




.18 




.18 




.14 




.14 




.13 




11 


Instructional Services Received per Year 


















































Regular Instruction 


89 


.98 


85 


.9"> 


97 


.47* 


89 


.83* 


91 


.63* 


86 


.61 * 


94 


.25 


94 


.33 


103 


.27* 


97 


.04* 


102 


. 53 


102 


.30 


Special instruction 


18 


.33 


17 


.23 


17 


.98 


20 


.70 


19 


.08 


22 


.10 


25 


.90* 


18 


.70* 


20 


. 50 


23 


.05 


1 7 


. 49 


16 


72 


Tutor/Independent Work 


62 


.90* 


56 


.49* 


58 


.02* 


62 


.68* 


64 


.65 


62 


.00 


57 


.39 


56 


.69 


50 


.66 


49 


.49 


45 


. 93 


43 


66 


Characteristics of Educational Process 


















































Support/Teaching Personne^ Ratio 




. 14* 




. 15* 




. 14 




.14 




.13 




.13 




.14 




.14 




.15 


.15 




.19* 




22' 


Years of Teaching 


1 1 


.65 


11 


.09 


13 


.45* 


11 


.23* 


11 


.60* 


10 


.81* 


12 


. 37 


12 


.12 


11 


.88* 


10.48* 


11 


.56 


11 


01 


Recent Inservice Training 


11 


. 5 3* 


9 


.72* 


10 


.88 


9 


.77 


9 


. 14* 


10 


.71* 


9 


.29 


8 


.62 


8 


.34 


7 


.50 


6 


.20 


5 


68 


Belief in Schooling 


5 


.81 * 


5 


.62* 


5 


.75 


5 


.82 


5 


.82 


5 


.70 


5 


.65 


5 


.58 


5 


.64 


5 


.72 


5 


.35 


5 


41 


Attitude to School Programs 


11 


.55* 


11 


. 28* 


1 1 


.22* 


10 


.82* 


11 


. 19 


11 


.21 


10 


.95 


10 


.77 


11 


.21* 


10 


56* 


10 


.96* 


10 


72* 


School s Minority Concentration 


38 


. 34 


36 


.66 


35 


.05* 


39 


.96* 


31 


.60* 


40 


24* 


33 


98 


33 


.41 


27 


.59* 


35 


.46* 


29 


31 


29 


51 


School s Poverty Concentration 


45 


.88 


44 


. 10 


41 


.45* 


45 


.06* 


40 


.57* 


46 


58* 


41 


.04 


41 


.46 


36 


.52* 


43 


80* 


35 


.59 


35 


14 


"School's CE Concentration 


18 


. 48* 


14 


.98* 


15 


. 37 


16 


.71 


14 


.21* 


18 


.21* 


13 


.89* 


17 


.35* 


11 


.70* 


13 


91* 


12 


.61 


11 


48 




39 


18 


38 


. 94 


37 


. 50 


39 


.08 


35 


.98* 


41 


35* 


36 


74 


37 


.14 


34 


.08* 


39 


09* 


35 


.58 


34 


73 


School's Central Resources 




44* 




.38* 




. 39 




.39 




35 




39 




33 




36 




.30 




27 




26 


26 


Parent/Community Involvement 


45 


14 


46 


.07 


44 


.48 


45 


.52 


43 


95* 


46 


.76* 


43 


82* 


45 


87* 


43 


.79 


43 


05 


41 


62 


40. 


60 


Principal's Instructional Leadership 


53 


93 


54 


27 


55 


.52 


53 


68 


52 


78* 


54 


50* 


53 


35 


53 


81 


53 


.37 


53 


14 


52 


90 


53 


31 


Teacher's Involvement in Decisions 


39 


38 


39 


.83 


39 


25 


39 


79 


38 


93* 


39 


70* 


38 


86* 


39 


79* 


38 


61 


38 


77 


39 


02 


39. 


15 


Disturbance of Instruction 


52 


28 


53 


23 


52 


21 


51 


.93 


50 


62* 


53 


83* 


49 


44* 


53 


20* 


49 


49* 


55 


16* 


53 


.32* 


56 


66* 


District's Testing Program 




99 




99 




.99 




99 




98 




98 




97 




98 




98 




97 




98 


99 


District's Percent of Administrative Staff 


4 


88 


4 


75 


4 


86 


4 


83 


4 


81 


4 


63 


4 


66* 


4 


96* 


4 


79* 


5 


19* 


4 


93 


4. 


76 


Effort in Curriculum Development 


12 


23 


11 


91 


12 


51 


12 


93 


10 


55* 


11 


81* 


12 


96 


12 


00 


12 


20 


11 


86 


12 


76 


12. 


70 


Teacher's Use of Lesson Plans 




96 




97 




95 




96 




94 




92 




95 




95 




96* 




92* 




98 




V 


Frequency of Feedback per Semester 


139 


03* 


129 


55* 


144 


80* 


134 


69* 


133 


71* 


125 


:9* 


138 


13* 


129 


04* 


129 


34* 


122 


31* 


120 


71* 


108. 


93* 


Weekly Homework Assigned 




36* 




30* 




50 




48 




81 




86 


1 


02 




93 


1 


22 


1 


25 


1 


39* 


1. 


29* 


Monthly Use of Materials 


49 


12 


48 


74 


47 


88 


47 


13 


41 


95 


41 


22 


38 


71 


39 


50 


39 


02 


38 


66 


35 


51 


35. 


44 


Individualization of Instruction 


15 


91* 


15 


59* 


15 


96 


15 


91 


16 


15* 


16 


67* 


16 


14* 


16 


63* 


16 


33 


16 


53 


16 


37* 


16. 


07* 


Monthly Use of Audio-Visual Equipment 


6 


08 


6 


58 


6 


81 


7 


48 


9 


22 


9 


86 


10 


08 


9 


79 


8 


97 


8 


50 


8 


74 


8. 


55 


Extent of Ability Grouping 


8 




8 


72 


8 


66 


8 


72 


8 


73 


8 


74 


8 


74* 


8 


90* 


8 


85 


8 


77 


8 


72 


8. 


84 


Class Size 


22 


95 


23 


39 


23 


56 


23 


80 


23 


97 


24 


55 


24 


70 


24 


89 


25 


13 


25. 


15 


26 


50 


26. 


40 



Grade 4 



Grade 5 



Grade 6 



High 



High 



High 



*Means for the two groups differ significantly at the .01 level 
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Table H-l 

Selected Interaction Terms for Examining the Differential Effects of Instructional Services Received, and 
Sl^rlin^wSSon.! Process on Reading Achievement Growth According to Student Characteristics* 



Instructional Services 
Received and Characteristics 
of Educational Process 



Interactions Between Student Characteristics (Columns)** and 
Educational Variables (Rows) for Predicting Posttcst Scores 



RACE 



PHP CE75 NEED MOED 



SUM! CE76 



Years of Teaching 

Parent/Cooounity Involvement 

District Control of Instruction 

Principal's Instructional leadership 

Weekiy Homework Assigned 

Monthly Use of Audio-Visual Equipment 



// 
// 



Amount of Special Instruction 

Amount? of Tutor/ Independent Work 

School's CE Concentration 

School's Low- Achiever Concentration 

District's Percent of Administrative Staff 

Monthly Use of Audio-Visual Equipment 



Amount of Special Instruction 

Amount of Tut or/ Independent Work 

Staff/Student Ratio 

Years of Teaching 

Highest Degree Earned 

School's Low- Achiever Concentration 



Amount of Special Instruction 

Disturbance of Instruction 
Effort in Planning and Evaluation 



Amount (»f Regular Instruction 
Support/Teaching Personnel Ratio 
Recent Inservice Training 
Weekly Homework Assigned 



// 
// 




Stepwise procedures were employed to select the significant interaction terms after all the main effects have 
stepwise ^wteuww . , „ . — _ „ mff*r*m. include pretest score* 8 student characteristics, 

A significant level of .0^ was jsed as tne criwrion variables and each of the four sets of selected 

s.s^^^rrcr^.rj: s rjsk- p™«> : ---- »^r nt ^» rcsrs 

"t^l«neo U slv. The« interactions „e then examined for their effects on resdino achievement orovth. 
RJCE. 1 - CCHn/^te. Mrnorrty: pP= 1 - P'"^^" Freehs ^"ne^of 'r^n, CE 



1 ~ o 
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lafcle H-2 



Selected Interact-on Terms for Examining the Oifre**.-»i*l Effects of Instructional Services Received, a.*vJ 
Characteristics cf Educational Process on Hath Achisvena*.. Growth According to Student Characteristic*. 



Instructional Services 
Grade Received and Characteristics 
of Educational Process 


Interactions Between Student Characteristics (Columns)** and 
Educational Variables (Rows) for Predicting Posttest Scores 

RACE FHP CE75 NEED KOED PI boU7 C£7£ 


Amount of Regular Instruction 

Amount of Tut or /Independent Work 

Years of Teaching 

Recent Inservice Training 

Belief in Schooling 

School's low-Achiever Concenti at ion 

Teacher's Use of Lesson Plans 

weekly Homework Assigned 


// 

/ 

// 

/ 

✓/ 

// 

// 

/ 


Amount of Regular Instruction 
Years of Teaching 
2 School's Minority Concentration 

School's Low-Achiever Concentration 
Parent/Comunity Involvement 
Weekly Homework Assigned 


/ 

// 

// 

// // 

// 
// 


Recent Inservice Training 
School's Low-Achiever Concentration 
Frequency of Feedback per Semester 
Monthly Use of Audio- Visual Equipment 


// 

// // 

/ 

/ 


Amount of Regular Instruction 
Amount of Tutor/Independent Work 
Years of Teaching 
School's CE Concentration 
School's Low-Achiever-* Concentration 
Frequency of Feedback per Semester 
Individualization of Instruction 
Extent of Ability Grouping 


// 

// 

// // 

/✓ // / ' 

/ 

// 

// / 

/ ,7 // 


Amount of Special Instruction 
Support /Teaching Personnel Ratio 
5 Attitude to School Programs 

School ' s Poverty Concentration 
School's Low- Achiever Concentration 


j 

// 

// 

// 

// 


Years of Teaching 

School's Poverty Concentration 


/ 

// // 



'stepwise procedures were employed to select the significant interaction terms after all the main effects have 
been entered into rhe regression model first. The mam effects include pretest score* 8 student characteristics* 
3 kinds of instructional services recei/ad, and the education -process variables that were found in the earlier 
analysis to contribute noticeably to the prediction of math posttest scores at the particular grade (see Table 6-8). 
A significant level o? .05 was used as the criterion at each of the forward selection and backward elimination 
steps. The interaction v-srms selected when the set of instructional-service variables and each of the four sats of 
selected education-process variables (characteristics of instructional personnel, educational environment* educational 
practices* and classrooa organization) were examined separately are marked with in the table entries. The mark 
is used to indicate those interactions retained in the :i -«1 stepwise analysis that considers all previously selected 
interaction terms simultaneously. These '..teractions are then ~*arained for their effects on math achievement growth. 

** RACE : 1 ■ Caucasian Ahite, 9 - Minority; FMP; 1 - participation in Fre«j- M .«als program, 9 m non-par ti cipat ion i 

CE75 ; 1 * Receipt of matn CE in 1975-76, 9 » non-receipt in 75; NEED : 1 - juoj*d to be in need of math CE by teacher* 
9 • not in need. MO ED. 1 » mother's educational attainment is high school graduation or more. 9 ■ U-^ than high 
school; PI: parental involvement in their own child s education; SUMI- extent of sunwr intellectual expeilc^ce 
in math (as Sumner Ac-ivity Slipsheet was not administered to the first graders, this varied le is omitted from the 
analysis for grade 1); CE76: 1 - participating in math CE in 1976-77, 9 - not participating. 
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Table H-J 

Effect* Between Student Characteristics and Educational Processes 



Agression Analyses for Examining the Interaction Effects Between Student Characteristics « a 

Riding Achieve- nt Growth on the Entire S*. P le of the first-Year SES Date Base) 



Variables Employed In the 
Multiple Regression Model 
for the Prediction of Reading 
Achievement Posttest Score 



r*(U> beta R ? <u> Beta 



Student Background Characteristic* 
Pretest VSS Score 
White/Minority Statu* (RACE) 
Free-Meals Participation (f«cp) J 
Receipt of CE in 197S-76 (CE75) Z 
Teacher'* Jttdgswnt of CE Need (SEED) 
Mother's Educational Attainment (HOED) 
Parental Involvesient in Child'* Education (PI) 
SUM: Intellectual Experience (SUMI)* 
CE Statu* In 1976-77 <«76) 

Xn*tmctional Service* Received 

5 tegular Instruction 
Special Instruction 
Tutor/Xndepervdent Work 

Characteristic* of Educational Process 

Staff/Student Patio 

Support/Teaching Personnel Ratio 

Years of Teaching 

Highest Degree Earned 

Recent Xnservice "Training 

Attitude to School Programs 

School's Minority Concentration 

School'* CE Concentration 

School's Low-Achiever Concentration 

School's Central Resource* 

Parent/Cotswmity Involverrfnt 

DUtrlct Control of Instruction 

Principal's Instructional Leadership 

Disturbance of Instruction 

District'* Percent of Adninlstrativw Staff 
- Effort in Planning and Evaluation 

Teacher's Use of Lesson Plans 

frequency of Feedback per Sewester 

Weekly Hoeievork Ass.gned 

Monthly U*e of Materials 

Individualization of Instruction 

Monthly Use of Audio-Visual Equipe*nt 

Classroost Achievement level 



Unique Contribution to the Squared Multiple Correlation (R^U)). 

and Standardized Regression Coefficient (Beta) 



Grade 1 

H . io. 1)2 



Grade 2 

N • 9.672 



Grade ) 
N • 9,917 



.176 

0-52 
.001 

ooc 

002 
00) 
00} 
NA 
.000 



MO* 
.169. 
-.048* 
- 007 
-.4)6* 
.0S9« 
041* 

-.046* 



.242 
.001 
.001 
.000 
.004 
.001 
.000 
.000 
.000 



.6*2* 
.034* 
-.0)6* 

- Oil 

- Ill* 
0)S« 

- 026 1 

- 006 
•.028* 



.2SS 
.000 
.000 
000 
00) 
.001 
001 
000 
.000 



S?W for the 'todel without Interactions 

Interaction Terns* 

Special Instruction x CE7$ 
Special Instruct iofi * SCMI 
Staff /Student Ratio x NEED 
Support/Teaching Personnel Ratio x RAcf 
Years of Teaching * CE76 
Highest Degree Earned x PI 
Recent Inservice Training x KACr 
Recent Inservice Training x MCFD 
School's CE Concentration x NEFC- 
" School's Low-Achiever Concentration x SPED 
School'* Low-Achiever concent rati or. x F>I 
Parent /Ccewunity Involvement * RACE 
District Control of Instruction x SEED 
Principal's Instructional Leadership x NFEO 
Disturbance of Instruction x SEED 
Disturbance of Instruction x P! 
Disturbance of rnstruftion x SIMS 
District's Percent of Administrative Staff * M 
Effort In Planning and Evaluation x CE76 
Weekly Homework Assigned x rMP 
Meekly Homework Assigned x CE7S 
weekly Hoeeworii Assigned x Pi 
Monthly U»* of Audio-Visual Equipment x TMP 
Monthly U»e of Audio-Visual Equipment x PI 



.002 


.0S1« 


.001 


.0)9* 


.000 


.001 


.0)0* 


.000 


• 009 


.000 


.001 


.040* 


.000 


-.009 


.000 


NA 




NA 




tf» 000 


VA 




NA 




\ NA 


.00) 


.064* 


.00) 


.0S6* 


% .000 


NA 




NA 




% .000 


.000 


-.009* 


NA 




NA 


NA 




.000 


-.001 


NA 


NA 




NA 




NA 


.002 


069* 


.001 


.060« 


NA 


NA 




.002 


- 100* 


00 B 


.000 


016* 


NA 




NA 


.001 


0S2* 


NA 




NA 


000 


.009* 


NA 




NA 


000 


ooe 


NA 




.000 


.001 


.027* 


NA 




NA 


NA 




.000 


- 02S« 


ooo 


NA 




NA 




NA 


.000 


.010 


NA 




NA 


NA 




NA 




NA 


000 


.02) 


NA 




NA 


NA 




NA 




NA 


NA 




NA 




NA 


• <*X 


-.007 


.000 


- 009 


NA 


NA 




NA 




NA 


.473 


(.692) 


67S 


( 822* 


7)7 



.7o8« 
01) 

- 007 
.006 

-.18&« 
038* 
.117* 
-.009 

- 029* 

.006 
-.014 
004 



.004 
.0)0* 



Grade 4 
N - 10.1V> 



Grade S 

N • 10.08* 



Grade 6 
N • 11.174 



R^U) 



.110 
.001 
.000 
.000 
.002 
001 
.000 
.000 
.000 

.ooo 

000 
.000 



.787* 
.041* 

- 02). 
-.029. 
-.06). 

029. 
Oil 
-.010 

- 010 

oos 

- 009 
.01) 



R 3 (R)for the Model with interaction* 

F Statistic, for the Contribution of Interaction* 



NA 




A 


NA 




J00 


NA 




NA 


NA 




NA 


000 


-.0)) 


NA 


NA 




NA 


NA 




NA 


NA 




NA 


NA 






SA 




NA 


NA 




too 


y*2 


- 1*2* 


NA 




1 * 


NA 




lit 


rJk 


NA 




NA 


NA 




NA 


NA 




NA 


NA 




000 


NA 




NA 


COO 


012 


NA 


ooo 




NA 


NA 




NA 


NA 




ooo 


000 


018 


NA 


482 


( o9S> 


676 



00O f 

ooo 



OH 



11 SI** 



J.76*' 



.740 ( 860) 
29 )1** 



RMU) 


bet* 


R J (U) 


Beta 

— " 




817* 


. V> 


.8JS* 


000 


.024 * 


.OOO 


.026* 






ooo 


• 024* 


ooo 


■ 018 • 


.000 


-.009 


000 


- 018 


.001 


-.047* 


* 0 




.ooo 


.019* 




nil * 


.000 


019* 




- 040* 


.000 


- 01S* 


* 


- .042 e 


.000 


- 002 


■ OOO 


.02S* 


.000 


.00? 


.coo 


.014 


.000 


- 000 


.000 


010 


.ooo 


.OCfi 


NA 




N. 




NA 




.ooo 


-.029* 


000. 


022 * 


NA 




NA 




NA 




NA 




.000 


.02)* 




* 


NA 




NA 




NA 




NA 




NA 




NA 




.000 


-.019* 


NA 








.000 


01)« 


NA 




NA 




NA 




NA 




NA 




000 


- 022 * 


NA 




NA 




NA 




000 


010 


NA 




NA 




000 


.008 


NA 




.000 


00) 


NA 




.000 


.026 * 


.000 


.006 


NA 




OOO 


-.012 * 


NA 




uOO 


-.012 


NA 




.000 


00 s 


NA 




.812 


( . >'Jl > 




( .906) 


NA 




NA 




NA 




NA 




NA 




NA 




NA 




.000 


022 


NA 




NA 




NA 




NA 




NA 




.000 


- 020* 


NA 




000 


016 


NA 




NA 




NA 




NA 




NA 




NA 




NA 




NA 




NA 




NA 




NA 




NA 






- <AU 


NA 




J"0 


002 


NA 




,»Q) 


.036* 


NA 




NA 




NA 




00 J 


042* 


NA 




NA 




NA 





.758 < 871) 
2 



81) (.901) 
5 01** 



.621 (.906) 
6 12** 



lhc present regression analyses The itair-J 
zero at the ,01 level 
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Table H-4 



Regression Analyses for Sxaalnlng the iteraction Effects ftween Student Characteristics and Educational Processes 
«* Reeding Achievement Growth (Based on a 15 K^?ent tendon Sa*ple frcn Each Grade) 



Variables E»ploy%« in the 
Multiple Regression Mod*l 
for the Prediction of Reading 
Achievement Posttest score 



Student Background Ov»racterl sties 
Pretest VSS Score 
white/Minority Status <wwr 4 
rr«-«-M*Ai» P*rt icipat ion tmp) 
Re'.elpt of Ct in 1975-76 (CE75) 
toclxt'j Jgdqeent of Ct Seed <tEtO> 
Mother *s> Educational Attainment (HOED) 
Parental mvolveswnt In Child'* Education i 
Suaver Intellectual irpenerce (Sl^:>* 
Ct Status in 1476-77 (Ct"»> 

Instructional Services Deceived 
Regular Instruction 
*peci«' Instruction 
Tuto* '"xlependsnt Work 

Characteristics 01 ""^'K-at ion* 1 Process 
Staf f/Student Ratio 
Support /Teaching Personnel Ratio 
tears of Teaching 
Highest Degree Earned 
recent inservice Training 
Attitude to tchool frogr*»» 
School's Minority Concentration 
School's CI ^oncent ratio*. 
School's LovAcntever T oncentr mon 
School's Central Re»c*irces 
Parent/Ccewunity Ir»volv*»*«nt 
District "ontrol of Instruct * >n 
Principal's Instruction*! !*»a<JerN^tp 
Disturbance of Instruction 
District's Psrcent of Mrinintutive .?t*fi 
Effort in Planning and Evaluation 
Teacher's fat of Lesson Plans 
rrequfney of feedback per Seee-ster 
Weekly Hcetewcrk Assigned 
Monthly Use of Materials 
Individualization of instruction 
Monthly Use of Audio-Visual Equipment 
Classroo* Achievement level 



t-nique Contributior w the Squared J*ultiple Correlation <R 2 <U>). 
and Standard!*^ ^egression Coefficient (Beta) 



Grade 1 


Grade 2 


Grade ) 


Grade 4 


Cradt 


5 


Grade 6 


S • 1. 


478 


N • 1 


414 


N - 1.46) 


n - : 


,481 


N - t. 


457 


N - 1 


618 


r>* <U> 


Beta 


R 2 (U) 


Beta 


R 2 (U) Beta 


R*(U) 


Beta 


R 2 (U> 


Beta 


R 2 <U) 


Beta 


169 


50ft • 


2)2 


Ml* 


2)4 684* 


)46 


791* 


)50 


811 * 


,)41 


.806* 


CO/ 


I7J 


.002 


049 


000 017 


001 


.060* 






.000 


.021 


004 


•,CM» 


000 


- oie 


.000 -.019 


.000 


- .017 


.002 


-.0*0 • 


"iw! 


"ft/!* 


,001 


•.042 




-.CI) 


001 .0)1 


.001 


•.050 


.000 


• 010 


000 


-.004 ^ 


000 


•.115 


01) 




,0Ci -.JI4* 


.002 


-.060* 


000 


054 


.00 ) 


• .074 


002 


.055* 


001 




, v r 047* 


.001 


.0 )) 


.000 


021 


.ooo 




.000 


•.000 


00* 


-.122 • 


.001 .18?* 


.vl 0 


-.002 


.001 


120* 


.001 


.041 


NA 




.000 


• 02? 


W0 002 


.000 


-.005 


002 


-.141 * 


.001 


-.023 


.. "0 


- 019 


000 


.022 


00) - 122* 


.000 


- . "^1 


.002 


'•.1)8 ' 


.ooo 


010 


OQl 




001 


0)1 


.000 • 004 


.000 


CO) 


OvC 


.006 


000 


005 


000 


,02"? 


000 


- 0)) 




.001 


-.041 


.000 


• <U0 


.000 


•.008 


.001 


.027 


.C00 


.006 


000 . 00 ) 


.000 


,ooi 


000 


Oh 


.000 


.025 


NA 




NA 




.000 .018 


NA 




NA 








NA 




NA 




NA 


NA 




NA 




.001 


• 06) 


.006 


6 • 


.002 


044 • 


.0^0 - 00) 


001 


.0)1 


.001 


.0)2 * 


NA 




•J 




NA 




.002 06) • 


NA 




NA 




NA 




.001 


0)0 


NA 




M 


NA 




NA 




.000 


.031 


NA 




.00. 


-.0)7 


SU 


NA 




NA 




NA 




NA 




NA 




NA 


001 


-f > )7 


NA 








005 


.10 J • 


.ooo 


• 00 


NA 


NA 




NA 




NA 




NA 




.301 


• 105 • 


009 •.»»• 


NA 




NA 




.001 


•.049 * 


.500* 


.014 


NA 




N> 


NA 




NA 




NA 








NA 




NA 


NA 




001 


0)1 • 


NA 




.002 


.04* 


NA 




NA 


NA 




SA 




NA 




001 


0lS 


NA 






NA 




NA 




NA 




002 


.05: 


NA 




NA 


NA 




000 


• 016 


NA 




NA 




.002 


• 069 • 


,-v>l 0)0 






NA 




NA 




NA 




NA 




NA 


NA 




.000 


010 


NA 




.001 


041 


SA 




NA 


NA 




NA 




.001 


.029* 


NA 


NA 




NA 


NA 




NA 




.001 


02b 


.003 


• 015 


NA 




NA 


NA 




NA 




.°01 


.057 • 


NA 




NA 




NA 


NA 




.000 


017 


NA 




NA 




NA 




NA 


NA 




.on 


-.0)0 


NA 




C"*0 


• 019 


.000 


001 




NA 




000 


- 022 


NA 




NA 




NA 




NA 


NA 




.001 


0)1 • 


NA 




51* 


1. 719) 


.674 




74) t.862J 


.768 


( 8767 


815 


( 90)) 


.821 


< 


NA 




NA 




NA 


001 


060 


NA 




NA 




NA 




001 


.052 


NA 


NA 




NA 




NA 




NA 




NA 




.001 ^99 


NA 




NA 




NA , 




NA 




NA 




NA 


NA 




NA 




.000 


06) 


002 


- 086 


NA 




001 064 


NA 




NA 




NA 




Na 




NA 




001 • 162 


NA 




NA 




NA 




NA 




NA 




NA 


NA 




NA 




.001 


• 050* 


NA 




NA 




NA 


NA 




NA 




na* 


.04 


NA 




00) 


101* 


. NA 


NA 




NA 
















.004 !&)* 


NA 




NA 




NA 




NA 




001 


079 


NA 


NA 




NA 




NA 




*3) 


- 190. 


NA 














NA 




002 


,157 


fO 




NA 


NA 




NA 




NA 




Qui 


.276 


NA 




NA 






NA 




NA 




NA 




NA 




NA 


NA 




.001 


• 087 


NA 




NA 




NA 




„ NA 


N> 




.001 


-.117* 


NA 




NA 




NA 




NA 


NA 




.002 


158* 


NA 




NA 




.001 


.067 


NA 


NA 




NA 




NA 




NA 




NA 




NA 


NA 




.002 


1)6* 


NA 




00 1 


.059 


NA 




NA 


NA 




NA 




NA 






056 


NA 




SA 


NA 




NA 




NA 




NA 




NA 




NA 


NA 




NA 




.001 


-.056 


NA 




001 


- 058 


NA 


NA 




NA 




NA 




002 


09) 


:j» 




NA 


NA 




NA 




NA 




.ill 


( 72^) 


681 


(.8. >> 


" 750 ( 666) 


,76« 


377) 


.820 


< 906) 


.624 


(.908) 


5 


87«« 


6 


)9 .. 


10. 64" 




4) 


10.40«« 


5 


77" 



R J (R> for t*e Model without Interaction* 



Interaction Teres* 

Special Instruction * *E?5 

Special Instruction x >--*<. 

Muff /Student Patio x NEE? 

Support/ Teaching Personnel Ratio / RACE 

Years oi Teaching *x CE**> 

Highes* ;*9« - e ^irr.ed x P! 

Recent Inservie Training x RACE 

Recent Inservic« Troining x M0E0 

♦cool's CE Com ent ratlin x *j$Xl 

School's IiOv-Ae> lever Conc*r-* ration x ne!I> 

School's liCw-Aw'.iever COncentr«C \on x PI 

Parent/Ccewwnit^ t nvolvts»ent x PAtt 

Oisv.. "ct Contrci of Ins tract ion x *>*ED 

Principal >" Instructional Leadership K Ntt- 

Disturhance ot '^struction x alio 

Disturbance of Insttv *ion x P! 

Disturbance A f (nstructiot. - SW1I 

District's Percent of Ad»inistia'»ve Staff x 

Effor* in Planning and Evaluation x s,:."** 

Heek* y Horw-ork Assigned x *>«r 

Weekly Hoeework Assigned x CE75 

weekly Hoeevork Assigned x PI 

Monthly Use of Aud t o-Vlsual Equipment x rMP 

Monthly Use of Audio'Visual Equiteunt ~x PI 



R 2 (R) for the rtodel wittj Interactions 

P Statistics for the Contribution of InteracMo 



f The variable Sus»»«r Intellectual Wparl.nce was not available in grade 1. and therefor, not used in tr. arMysi. :or that grada 
*S«e Table H«l for *n expla'nation of the selection of interaction t.r»s to be. Included in the present regression analyses The s .rred entries 
In the Bet* colu»n indicate that the regression coefficients are significantly different froo zero at the .01 level 

«-rti-l onntributlon of the coobined interaction teres to the posttest -score variance is significant -t the 01 level The degrees .f freedom 
US Suiier" oH«![.5c£n t.I5 ftTth7«*.rator. and M-l .inus nue^er of pr^iictor, in the -od.1 <«in ^fect. and interaction,) foi . dencealnator. 

— a«v neoatlve coefficients for 'CE Status in 1976-77' should not be carelessly Interpreted as hamful effects of CZ in the present conteit, 
5i. ToJ^t^Z cll u lLll lZX v2«S e. . reflation .C the achi.ve«nt difference, attrib table to other unmeasured student characteristic, 
that are correlated with CE Status (w* Chapter ) f?r aore explanation). 
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Table H-S 



Variables Empl<>Y*<l In the 
Multiple Agression Model 
for the Prediction of Kith 
Achievement Posttest Score 



r*(U> B*ta 



Student Background Char meter istics 
Pretest vss Score 
white/Minority Status ^ RACE > 
rree-M»*ls Participation (WP) 
Receipt of CE in 19JS-76 (C£',S) 
Teacher '» .Judgment of CE Need <stK» 
Mother's Educational Attainment (MCCD) 
Parental Involvement In Child's Education (PI) 
Summer Intellectual Experience (SUMI>t 
Ct Statu* In 1976-JJ (C£J6> 

Instructional Services Received «" 
Regular Instruction 
Special Instructs 
Tutor /Independent *X>r* 

Characteristics / Educational Process 

Support /Teaching Personnel Ratio 

Years of Teaching 
' Recent Inservlce Training 

Belief in Schooling 

Attitude to School Pro<jr**» 

School Minority Concentration 

School's Poverty Concent»atlon 

School's CE Concentration 

School's Low-Achiever Concentration 

School's Central Resources 

Parent / Co— unity Involvement 

Principal's li.structlonel leadership 

Teacher's Involvement In Decisions 

Disturbance of Instruction 

District's Testis Program 

District's Percent of Administrative Staff 

Effort »n Curriculum Development 

Teacher's Use of Lesson Plans 

frequency uf feedback per Semester 

Mtekly Homework Assigned 

Monthly Use of Kafrlal* 

Individualization of Instruction 

Monthly Use -f Audio-Visual Equipment 

Extent of A.illt> Crouping 

Class Size 



R^Rl for the Model without Interactions 



Inter*-* ion Terms* 

Regular instruction x NEED 
Regular :nst ruction x SWl 
Tutor /Independent?«ork x RACE 
Support/Twching Personnel Ratio x FMP 
'Years o' Teaching x RACE 
Years of Teaching x NEED 
Years of Teaching x SUMl 
Recent Ins^-vlce Training x MCED 
Belief *n Schooling x CE76 
Attitude to School Programs x CE76 
School's Xlnority Concentration x NEED 
Schools' Poverty Con entration x RACE 
School's Poverty Concentration x SEED 
Sctvool's Poverty Concentration x PI 
Schools' CE concentration x CE7S 
school's CE Concentration x NEED 
School's Lov-Achlever Concentration x RACE 
.School'* iov-Achlever Concentration x rw 
School's low-Achiever Concentration x CE7S 
School's tow-Achiever Concentration x SUMI 
School's low- Achiever recent rat Ion x CE?6 
Parent/Oses-unlty Involvement x CE76 
Taacher's Use of Lesson Plans x n0> 
frequency of /eedback per Semester x NEED 
weekly Hoswvork Assigned x CF'6 
Individual. ration of Instruction x r>0> 
Extent of Ability Crouping x MOED 
Extent of Ability grouping x SUM! 



Unique Contribution to the Squared Multiple correlation (**<U». 

and St\ndardi*ed Regression Coef f icient^(Seta) 



Grade 1 
N • 10,202 



Grade 2 
N - 9.226 

R*(U> Beta 



Grade 3 
N - 9.216 

R? (U) Beta 



R*(U> Beta R 7 (U> Beta 



22? 

000 
001 
,001 
008 

,001 

001 



,ss> 

039* 
-.120* 
.044' 
- 1*5* 
.033* 
040* 

-.03! 



.002 
.001 
.000 
.006 
.001 
.000 
.000 
.000 



.606* 
.068* 
-.09S* 

013 , 



-.131* 
.042* 
.021* 
•.012 
-.016 



.216 
.003 

.000 
.001 
.01* 
001 

•ooo 

.001 
.000 



.561* 
183* 
-.017 
-.107* 
-.134* 

.034* 

.007 
-.038* 

.016 



000 .022 

000 * .018 

001 .0)6* 



002 .OSS* 
.000 .00$ 
.000 -.013 



oox 

000 
001 



,002 
,000 



.069» 
-.013 
.036* 



.OSS* 
.022* 



.003 .071* 
.000 .011 
.001 .033« 



.000 -.023 



.002 
KA 
.000 



.000 
.001 



.012 
.033* 



.000 
.001 



001 
.000 



-.012 

034 



-.032 
.013 



Grade 4 
N • 8.961 



Grade * 
N - 10.406 



Grade 6 
H - 10.940 



.2»5 
.000 
.000 
.000 

.COS 
000 
000 

.000 

.ooo 

.002 
003 
.00? 



.ooo 

.000 



.000 
.004 



.675* 

.043 
077 

.003 
- 199* 
-.040 

.008 

.0)5 
-.024* 

.057* 
.068* 
107. 



-.0*0* 
.008 



-.034* 
-.102* 



.000 
.000 
.000 
.003 

.000 
000 

.ooo 

000 

.002 
.000 
.001 

.o>x> 

.001 



.69S* 

.016 
-.016 
-.020* 
- 12'* 

.01) 

.021* 
-.030 

.Oil 

067. 
.028* 
.047* 

.016 
.027* 



.587 
.001 
.000 
.000 
004 
.001 

.ooo 

.000 

.ooo 

.001 
.c >> 

ooo 

.001 
.000 



.750* 
051* 
-.024* 

.001 
-.080* 
.031* 
037* 
-.012 
.006 

.049* 
.015 
.026* 

-.027* 
.020* 



.000 
.001 



.ooo 

.000 



-.011 
-.018* 



-.007 
.023* 



.000 
.000 



.003 
.023* 



.001 
.001 



.001 
.000 



.032* 
.03 3* 



.038* 
-.015 



•-C64* 



.000 -.009 



NX' 
NA 



.122* 
.104* 



.000 
.000 



-.078* 
068* 



oo : 

NA 
.001 



NA 
NA 
NA 



NA 
NA 



.165' 
117* 



R* (R) for the Model with Interactions 
r Statistics for :he Contribution of Interac tions 



.471 (.686) 
10.42* 



. ( 739) 
4.44* 



S99 <."4> 
41.0?*' 







NA 


NA 


OvO 


-.010 


NA 


NA 


001 


-.099* 


NA 


NA 


NA 




.*0* -.04«' 


NA 


001 




NA 


NA 


001 


0S1* 


NA 


NA 


NA 




NA 


NA 


HA 




NA 


NA 


NA 




NA 


NA 


NA 




000 - 048 


NA 


NA 




NA 


NA 


NA 




NA 


.000 ..023 


NA 




001 .068' 


NA 


NA 




NA 


000 - 038* 


.001 


•.064' 


NA 


NA 


.003 


092' 


NA 


NA 


SA 




NA 


NA 


NA 




NA 


NA 


NA 




NA 


NA 


NA 




.000 .015 


'1A 


NA 




NA 


N> 


NA 




NA 


NA 


piA 




V* 


1. . 

NA 


ooo 


.027 


pi/* 


NA 




NA 


NA 


000 


-.088 


NA 


NA 


ooo 


.082 


NA 


NA 
NA 




- 052 


NA 


.639 


( 799) 


6,0 (.810) 


.685 (.821) 


16 03** 


12. 67** 


9.82** 



I contribution or interaction* — 

«. - T»L to, «. — « of co.ff.o.«t fo, ■« ■ 
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Table H-6 



Regression Analyses for Examining the Interaction Eff«Ct* Batveen Student Character lit lei and Educational Processes 
on Kith Achievement Crowth (Based on a IS percent Random Sample fro* Each Crade) 

























*5 — 








Unlgve Contribution to-the Squared Multiple Correlation <RMU)>, 






Variables Employed tn the 








and Standardized Regression Coefficient 


(Beta) 








Multiple Regression Model 
























c for the Prediction of Kith 


Grade I 


Crfide 2 


Crade J, 


Cr«1e 4 


Crade S 


Crade 6 


Achievement Posttes* icre 


N - 


.4S7 


M • 1 . )S4 


M • l.)S7 


N - 1 


,)0) 


N • 


1.S06 


N • 1 


.sso 




p"(0) 


Beta 


(Ul 


Beta 


b2 f m ^ T 
R* (Ui Beta 


R* (0) 


Beta 


r'(O) 


Beta 


R*(u> 


Bet* 


$tud«nt Background Character i sties 




















. its 




Pretest VSS Score 






.28) 


.6))* 


,2J) .S8)* 


.271 


.6S9* 


)1) 


.710* 


.74)* 


WMte/Mlnority Status (MCE) 


noi 


"oso 


.001 


0S2 


.002 .160* 






000 


.02* 


.C5) 


■ 120* 


Pree-Meals Participation (f>P> 


"noj 


266* 


.002 


• DIs 


000 • 010 


"ooi 

' . 


. 16S 


«• .000 


.0)0 


.001 


-.0)S 


Receipt of CE tn 197S-7* (CE7S) 


ooo 

' 




.001 


.044 


.001 -.099 




.066 


.000 


* OOS 


.000 


-.017 


Teacher's Judgment of CE Need <NEEX» 






-00) 


-.Wl' 


.011 • 141* 


" 010 


-.296* 


.OOS 


-.1*6' 




-.064* 


Mother's Educational Attainment (HOC) 


Ofll 


041 

* 


.002 


04 S 


.001 -.049 


"o02 




.000 




00) 




Parental Involvement In Child's Education (Pt ) 


"not 




.001 


02S 


.000 .018 


"ooo 


"*004 




.02S 


.001 


**047 


Suotr Intellectual Experience (SUMI)t 






002 


-.077 


.002 -.049* 


002 


.295* 


001 


.06& 


.001 


-.0)1 


CE Status Ha 1976-77 (CE76) 


001 




.000 


- 008 


.001 -.0)0 


"ooo 


-.012 


.001 


. 107 


.001 


-.041 


Instructional Services Becelved 










». 














Regular Instruction 


.000 


.004 






OOS 087* 


.00) 


.077* 


.C32 


.064' 


.000 


.014 


Special Instruction 


.000 


008 


000 


-*012 


"oOi *04S 


.00) 


.070* 


.000 


.026 


.000 


.004 


Tutor/Independent work 

* 


J00 ( 


.014 


.000 


-.002 


"o02 *048* 


.004 f) 


.1)0' 


.001 


047 


.000 


.010 


Character! sties of Edue ional Process 
























Support/Teaching Personnel Patio 


MA 




NA 




NA *■ 


KA 




.00. 


.OSS' 


.001 


0)1 


Years of Teaching 






OOS 


.079* 


KA 


.000 


..0)2 


.001 


.028 


.002 


.048* 


ReC»nt In»ervlc« 1 alning 


OOA 

■ 




KA 




.004 -.1))* 




.026 










Belief In Schooling f 




0S7* 


HA 




KA 


NA 




KA 




.00) 


-.0S4* 


*tti:ude to School Programs % s 


"na 




KA 




KA 


KA 




.001 


.0)9 


KA 




School's Minority Concentration 






.001^* 


061 


.000 .0)7 


"na* 












School's Pov»rt/ Concentration 


-NA 




KA 




NA 






.000 


.008 


oo) 


.1)5* 


School's CE Concentration 


»NA 




KA 




NA 


.000 


-.021 


KA 




KA 




School's Lov-Achiever Concentration 


oos 


098* 






.004 -.178* 


.OOS 


-.114* 


.002 


-.077' 






Seitool's Central Kesources 


.001 


.0)8 


NA 




NA 


KA 




KA 




KA 




ParSnt/Coemunlty Involvement 


MA 






.027 


KA 


KA 




.001 


.0)8 


KA 




Principal's Instructional Leadership 


MA 




KA 






.001 


•.0)) 


NA 


-.019 


KA 




Teacher's Involvement In Decisions 


KA 




.000 


-.020 


KA 


KA 




.000 


KA 




Disturbance of Instruction 


NA 




NA 












-.0)6 






Olstr let's Testing Program *" 






KA 




.001 • 0)) 


WA 








NA 




Olstrlct's Percent of Administrative Staff 


NA 




KA 




.00) .059* 


KA 


















KA 




NA 


KA 






*' 


000 


019 


Teacher's Vse o* Lesson P' ins 


002 


064* 


KA 




NA 






.001 


.026 






Frequency of reedback per Semester 






. KA 

„- looo 




.000 .014 














Weekly Momev>rk Assigned 


.002 


.04) 


-.016 


KA 


KA* 


.06) 


NA 




001 




Monthly ise of Materials 


NA 




.002 


.051* 


KA 






KA 




KA 




Individualization of Instruction 


NA 




KA 




.002 - 04) 


nnn 


.00) 


NA 






.06)* 


■*>nthly Use of Audiovisual Equipment 


NA 




NA 




.001 .0)) 


"ka 




'ka 




001 




Extent of Ability Grouping 






NA 




NA 


004 


110* 


KA 




KA 




Class Size 






.001 


•.029 


000 -.024 






KA 




KA 




> * 
BMP) for *he tooel without Interactions 




( 


566 


(.7S)> 


.636 (.797) 




< 794) 


678 


( 


.702 


( 8*8) 


Interaction Terms* 
























Regular Instruction x VEED 




• 10) 


NA 




NA 


NA 




KA 




KA 




Regular Instruction x SUM I 






KA 




KA 


.0C1 


.,089 


KA 








Tutor/ ind«pende it Work x race 






KA 




KA 


.002 


- <16* 


NA 




KA 




£»oport/T«*e*»ing ^ecsonnel Ratio x rNP 






KA 




"» KA 






00) 


- 097' 


NA 




rears of r*act«. * $ x RACE 


' 


- 


NA 




NA 


001 


.097 


KA 








Years of Teaching x NEED 


NA 




KA 




KA 




.091* 


KA 




KA 




Years of Teaching x SUM I 


NA 




.001 


099* 


NA 


"ka 








KA 




Recent Inservlce Ttalmnq x wCfD 






NA 




.00) .128* 










KA 




Ballet in Schooling x CE76 


002 




NA 




NA 


NA 




KA 




NA 




Attitude to School Programs x CE76 


' N 




NA 




NA 


NA 




.001 


-.116 


KA 




School's Minority Concentration x NEED 






002 


•.084* 


KA 


NA 








KA 




School's Poverty Concentration x RACE 


NA 








KA 


NA 




KA 




.002 


-.075* 


Schno*** Poverty Concentration x NEED 


NA 




KA 




KA 


NA 




.00) 


.1)9» 


NA 




School** Poverty Concentration x Pi * 


NA 




KA 




NA 


NA 




KA 




.001 


-.056 ) 


School's CE Concentration x CE7S 


NA 




KA 






010 


-.168* 


KA 




KA 




School's CE Concentration x NEED 


NA 




KA « 




NA 


004 


.108' 


KA 




NA 




School's Lo*"Achtever Concentration x PACE 






NA 




.00) -.164* 


NA 












Softool's Low- \chlev«r COncentratl**n x fMP 


NA 




.002 


.177 


NA 


NA 




N\ 




KA 




School's tovAchlever Concentration x CE7S 


NA 




KA 




.002 147' 


NA 




KA 




ka' 




School s Low~Achiever Concentration x SUHI 


NA 




NA 




NA 


NA 




.001 


.104 


NA 




School's Low-Achiever Concentration x CE76 


.008 


286* 


' .00) 


-.2l4» 


KA 


NA 




NA 




KA 




Parent/Community Involvement x CE76 


NA 




.002 


.1S2 


NA 


KA 




KA 




KA 




Teachar's Jse of Let son Plans x PHP 


.002 


.2)7 


KA 




NA 


KA 




KA 




KA 




frequency of reedback per Semester x NEED 


NA 




KA 




NA 


002 


.110' 


KA 




KA 




Weekly Ho«* work Assigned x CE76 


NA ' 




.002 


.066* 


KA 


KA 




KA 




KA 




Individualization of Instruction x fKP 


NA 




KA 




KA 


.OCl 


-.214 


KA 




KA 




Extent of Ability Crouplng x MCEO 


NA 




KA 




KA 


.00) 


.)61' 


KA 




KA 




Extent of Ability Crouplng x SWtl 


NA 




KA 




NA 


.001 


•.227 


NA 




KA 




R 1 (*) for the » del with Xnterect<ons 


.S01 


(.707) 


.S76 


(.760) 


.64S (.60)) 


.6S7 


(.811) 


.666 


(.628) 


.70S 


(.840) 


r Statistics for the Contribution of Interactions 


3 


40»» 


6. 


26** 


11.))" 


9.84** 


9 


,66" 


6. 


71** 



The variable Summer Intellects 
Sea Table K>2 for an explanation 
in the Beta column lrdlcate that 

»e 

The partial contribution * . th- 
ere member of irteract J ~) terms 
Mote — See Table M-) for the mean. 



.rlence was not available for grade 1. and therefor* not used In the analysis for that grade 
*a ■•lection of Interaction term* to be Included In the prement regression analyses. Th* ■ tarred entries 
agression coefficients are algnlf lcartly different from zero at the .01 level. 

* interaction tenia to the posttest-score variance Is significant at the 01 level The degrees of freedom 
numerator, and M~l minus number of predictors in the model (main effects and interactions) for the denominator. 

flth* coefficient for 'CE status in 1976-77'. 
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Table H-7 



Means and Standard Deviations (S.D.) of Fall-to-Spring 
Gains for Non-CE Students Judged as Needing CE and 
Attended Schools Whe •* CE in the Subject Area Was Not Provided* 



VSS Gain Z-Score Gain 



Grade 



Mean S.D. Mean S.D. 



Reading 

1 

2 
3 
4 
5 
6 



52.79 


36.70 


-.113 


.864 


38.41 


36.95 


-.J046 


.677 


29.48 


37.16 


-.030 


.633 


30.25 


34.95 


.012 


.546 


22.60 


36.48 


-.020 


.502 


25.14 


36.15 


.010 


.481 



Math 

1 

2 
3 
4 
5 
6 



49.13 


35.91 


-.145 


.825 


46.74 


40.26 


-.058 


.791 


50.11 


42.66 


-.037 


.771 


46.97 


45.30 


-.003 


.679 


35.75 


45.34 


-.008 


.622 


33.73 


47.66 


-.036 


.601 



W z-score gains were the differences between fall and spring 
Chievement scores measured in terms of standardized normal dexvates 
( Z ) These data were used to assign CE students to growth groups, 
inose Sieved gains one s.d. greater and smaller than the ^ corres- 
ponding means in both types of gain scores were assigned to the 
Vigh' and 'low' growth groups, respectively. The rest of the CE 
students were assigned to the 'comparable' growth group. 
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Table H-8 



Percentage of CB Students Whose Fall-to-Spring Growth i« High. Comparable, or Low 
in Cosiparison with the Average for Non-CE Students Judged to Havo Need for CE 
But Attending Schools That Do Not Provide CE in the Subject Area* 





Fall-to-Spring 


Subgroups of CE Students 






G 




















R 


Growth telative to 




Title 


I 


Other -CE 


CE 








A 


the Average for the 




Students 


Students 


Student 8 


local 




D 


Needy Non-CE Students 


in Title I 


in Title I 


in Other-CE 




E 


in Non-CE Schools* 




Schools 


Schools 


School 8 












N 




N 




N 


% 




% 




r\ 1 * * — V- 1 — ^» # # 

Hejuzincj Acnievemenc 






















High 




444 


15.9 


139 


14.1 


71 


12.4 


o34 


13 . 1 




Comparable 


2, 


090 


75.0 


765 


77.5 


434 


7F.6 


3,289 


7«\ 7 
/3 « * 


1 


Low 




251 


9.0 


83 


8.4 


69 


12.0 


403 


7 . J 




Total 


2, 


785 


99.9 


987 


100.0 


574 


100.0 


4,346 


100.1 




High 




437' 


14.4 


122 


12.9 


119 


16.9 


O ' O 


1 A ^ 
14 . 3 




Comparable 


I, 


325 


76.6 


729 


76.9 


528 


75.0 


3,582 


76,4 


2 


LOW 




274 


9.0 


97 


10.2 


57 


8.1 


428 


9. 1 




Total 


3, 


036 


100.0 


948 


100.0 


704 


100.0 


4,688 


100.0 




High 




374 


12.4 


81 


9.2 


96 


15.3 


551 


12 2 




Comparable 


2, 


439 


80.7 


711 


80.4 


479 


76.2 


3,629 


80.0 


3 


Low 




209 


6.9 


92 


10.4 


54 


8.6 


3JJ 


7 . 8 




Total 
< 


3 


022 


100.0 


884 


100.0 


629 


100.1 


4,535 


100.0 




High 




349 


^ a a 

14 . D 


°1 


10.5 


89 


14.4 


3<7 


13 7 




Comparable 


1 


703 


71 . 2 


660 


76. 4 


** Jl 


69 6 


2 ,794 


72. 1 


4 


Low 




340 


14.2 


113 


13.1 


99 


. 16 «° 


552 


14. 3 




Total 


2 


392 


xoo.o 


864 


100.0 


619 


"100.0 


3,875 


100.1 




High 




279 


12 . 5 


cc 

u3 


8.1 


86 


14.7 


430 


11.9 




Comparable 




710 


76. 8 


659 


82 . 2 


440 


75.0 


2,809 


77.7 


5 


Low 




238 


10.7 


78 


9.7 


61 


10.4 


377 


10. 4 




Total 


2 


,227 


100.0 


802 


100.0 


587 


100.1 


3,616 


100. 0 




High 




231 


11.7 


97 


in 7 
1U. / 


47 


7.6 


37«> 


10.7 




Comparable 


1 


,529 


77 . 1 


718 


/7 . J 




78.9 


2,736 


78.0 


6 


Low 




222 


11.2 


90 


9.9 


84 


13.6 


J70 


11 . 3 




Total 


1,982. 


100.0 


905 


99.9 


620 


100.1 


3 , 507 


100 • 0 




Math Achievement** 






















High 




355 


22 .2 


143 


16.7 


74 


22.5 


572 


20. 6 




Comparable 


1 


,119 ' 


70.0 


627 


73.3 


225 


68.4 


1,971 


70. 9 


1 


Low 




124 


7.8 


85 


9.9 


30 


9*1 


239 


8 b 




Total 


1 


,598 


100.0 


855 


99.9 


329 


100.0 


2,782 


100.1 




High 




282 


16.7 


116 


14.4 


52 


17.9 


450 


16 2 




Comparable 


1 


,245 


73.8 


627 


77.6 


211 


72.5 


2,083 


74.8 


2 


Low 




159 


9.4 


65 


8.0 


28 


9.6 


tot 


7.1 




Total 


1 


,686 


99.9 


808 


100.0 


291 


100.0 


2,785 


100.1 




High 




269 


15.0 


86 


11.2 


34 


9.2 




13 3 




Comparable 


1 


,381 


77.0 


580 


75.5 


281 


76.2 


2 ,242 


76.5 


3 


Low 




143 


8.0 


102 


13.3 


54 


14.6 




10 2 




Total 


1 


,793 


100.0 


768 


100.0 


369 


100.0 


2,930 


100.0 




High 




219 


15.3 


95 


11.2 


34 


9.1* 




13 1 




Comparable 


1 


,094 


76.3 


646 


•76.5 


269 


72.1 


2,009 


75.8 


4 


Low 




121 


8.4 


104 


12.3 


70 


18.8 


473 


11 . 1 




Total 


1 


,434 


100.0 


845 


100.0 


37 3 


100.0 


'2,652 


100.0 




High 




270 


16.5 


93 


12.1 


57 


14.3 


370 


14.8 




Comparable 


1 


,004 


75.4 


576 


75.0 


307 


76.8 


1,881 


75.5 


5 


Low 




107 


8.0 


99 


12.9 


36 


9.0 


242 


9.7 




Total 


1 


,331 


99.9 


768 


1C0.O 


400 


100.1 


2,499 


100.0 




High 




206 


18.2 


130 


15.2 


58 


12.7 


394 


16.1 




Comparable 




831 


73.3 


653 


76.1 


350 


76.6 


1,834 


74.9 


6 


Low 




97 


8.6 


75 


8.7 


49 


10.7 


221 


9.0 




Total 


1 


,134 


100.1 


858 ' 


100.0 


457 


100.0 


2,449 


100.0 



*High - at least one s.d. above the everege, Ocar^areble » within ± one s.d. of the 
average, end bow - at least one s..d. below the average. 

*Chi-aquare statistics show significant association betwee.i CE categories and growth 
groups at the .01 level for grades 3 and 5 in reading, aid grades 3, 4, and 5 in aath.. 
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Table H-9 * - 

sets rtssrs^srrirss ti^r-SK «« *> ~ »*-*. « 



. Potential 
Discriminating 
Variables 



Student Characteristics 
■ Pretest Achievement Quartile 
'participation in Title I Programs 

instructional Services Received Per Year 
Regular Instruction 
Special Instruction 
Tutor/Independent work 

Characteristics of Educational. Process 
Staff/Student Ratio 
Support/Teaching Personnel Ratio 
Year of Teaching ' 
Highest Degree Earned 
Rtcent Inservice Training 
Attitude to School Programs / 
- Schools' Minority Concentration 
School's CE Concentration 
School's Low-Achiever Concentration 
School's Central Resources 
Parent /Community Involvement 
District Control of Instruction 
Principal's Instructional Leadership 
Disturbance of Instruction 
District's Percent of Administrative Staff 
Effort in Planning and Evaluation 
Teacher's Use of Lesson Plans 
Frequency of Feedback per Semester 
Meekly I*omework Assigned 
Monthly Use of Materials 
Individualization of Instruction 
'Monthly Use of Audio-Visual Equipment 
CI ass roc* Achievement Level 



Means for Reading CE Students with 'High* and 'Low' Achlevemen Crowth 



Grade 1 



Grade 2 



Grade 3 



High 
564 



Low 
330 



High 
559 



Low 
359 



High 
501 



Low 
293 



1.57* 
.68* 



123.09* 
100.74 



2.25* 
.59* 



104.47* 
105.09 



90.32 82.15- 



.07 
.13* 
10.57 
2. 58 
18.05* 
11.66 
61.77* 
61.55* 
53.05* 
^83* 
54.11* 
43.03 
56. 46*' 
59.68* 
5.04 
23.95* 
.92 
121.71 
.70* 
79.97* 
20.65 
30.34* 
.65 



.07 

.15* 
9.88 
2.52 
11.30* 
11.44 
41.11* 
42.22* 
44.79* 

.67* 
48.26* 
42.11 
54.44* 
55. ?5* 

5.01 
21.38* 
.95 
115.75 
.50* 
72.99* 
20.40 
22.84* 
.58 



1.36* 

.63 



105.01 
96.79 
87.63 



.07* 
.13* 
11.87* 

2.59 
15.02 
11.53 
,44.86 
46.91. 
45.59* 
.71 
49.72 
42.57* 
54.84 
55.24 

4.91* 
24.17 
.88 
118.63 
.64 
76.20 
21.06 
26.54 
.53 



2.02* 
.64 



100.28 
105.55 



.08* 
.15* 
10.64* 

2.58 
17.39 

II. 55 
50.62 
49.16 
47. *9 

.69 
50.04 
41.52* 
54.65 
58. 11 

5.80* 
23.89 
.90 

III. 34 
.62 

78.63 
1 20.93 
26.02 
.49 



I. 29* 
.69* 

86.93 
102.65 
82.37 

.07 
.14', 

10.82 
2.60 

13.46 

II. 33 
49.54 
48.02 
48.71 

.79 
50.54 
42.03 
54.71 . 
55.38 
5.02 
22.86 

.85 
120.10 

.53 
68.07 
21.93 
29.96* 

.CO 



2.04* 
.60* 

86.45 
99.39 
75.18 

• .07 
.14 
9.84 
2.56 
12.74 
11.31 
45.81 
47.25 
47.20 
.74 
50.50 
41.46 
55.68 
57.14 
5.15 
21. S9 
.86 
118.58 
.56 
66.62 
21.62 
.22.24* 
.52 



Grade 4 



Grade S 



Grade 6 



High 
475 



Low 
475 



High, 
362 



Low 

301 



High 
298 



Low 
304 



I. 23* 
.65 

78.93 
87.50 
69.33 

.07 

.15 
12.70 . 
2.75 
17.17 

II. 00 
54.07 
48.'j6 . 
50,88 

.81* 
50.07 
41.18. 
53.99 
55.03* 
4.96* 
24.06 

.92* 
110.12 

.64 . 
63.62 
21.72 
29.65 

.54 



1.49* 
.64 

79.66 
86.63 
71.80 

" :07 

.IS 
11.76 
2.71 
16.21 
10.65 
53.55 
.48.11 
52.29 

.74* 
48.44 
41.81 
54.54 
58.57* 
5.50* 
23.70 

.86* 
110.93 

.70 
64.55 
21.97 
29.24 

.55 



1.22* 

.67 

82.60 
78.99 
64.85 

.07 . 
.13* 
11.14* 
2.67 
14.70 
10.62 
49.81 
41.40 
47.27 
.75 
48.29 
42.01 
54.49 
> 55.50* 
4.96 
23.49* - 

.94 
95.63 
.73 
63.57 
21.70 
26.41 
.43 



Ml' 

.61 



78.61 
74.89 
65.68 

.08 
« .15* 
' 10.54 
2.62 
13.48 
10.68 
48.74 
44.30 
49.13 

.68 
47.28 
41.5? 
54.50 
61.09* 
5.03 
21.92* 

.90 
96.00 

.63 
66.75 
21.77 
24,-86 

.46 



1.19* 1.41* 
.67 «61 

83.39 79.31 
76.21 71.46 
64.34 56.14 

.08 
.15 
1*2.31 
2.72 
18,53 
10.10 
64.43 
50.40 
55.09 
.77 
49.50 
41.92 
54.52 
61.97 
5.62 
23.07* 

.97 
89.60 
172 
60.11 
22.00 
29.15 
- .45 



*Means-fbr the two* groups differ significantly at the .01 level. 

q i difference, in H's b**een this table and Table H-8 are due to missing data for the educational variables. 
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Table H-10 

Means of the Potential Discriminating Variables Employed in the Discriminant Analysis for the Two Groups of Math 
CE Students Whoso Fall-to-Sprlng Achievement Growth is at Least One Standard Deviation Higher oTi^r toll tte 
Average for the Non-CE Students Judged to Have Need for CE But Attending Schools That Do Not Provide Math CE 



Potential 
Discriminating 
Variables 



I Student Characteristics 

Pretest Achievement Quart lie 
Participation in Title I Programs 

! Instructional Services Received per Year 
Regular Instruction 
Special Instruction 
Tutor/ Independent work 

Characteristics of Educational Process 
Support/Teaching ^er'soni.el Ratio 
Years of Teaching 
Recent T nservice Training 
Belief in Scnoolmg 
Attitude to School Programs 
School's Minority Concentration 
School's Poverty Concentration 
School's CE Concentration 
^School *s low-Achiever Concentration 
School's Central Resources 
Parent/Community Involvement 
Principal's Instructional Leadership 
Teacher's Involvement in Decisions 
Disturbance of Instruction 
District's Testing Program 
District's Percent of Administrative Staff 
Effort in Curriculum Development 
Teacher's Use of Lesson Plans 
Prequency of Feedback per Semester 
WeeUy Homework Assigned 
Monthly Use of Materials 
Indi 'idualization of Instruction 
Monthly Use of Audio-Visual Equipment 
Extent of Ability Grouping 
Class Size 



Means -for the two groups differ significantly at the .01 level 
Note 




Tne differences in N's between this table and Table H-8 are due to missing data for the educational variables. 
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